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Public libraries are currently the conduit for local, 
state, and federal funds used to support reference referral and other 
reference-related functions in California. Given potential funding 
constraints, this 5-month study expanded its original scope — to 
assess the cost effectiveness and efficiency of the Bay Area 
Reference Center (BARC) and the Southern California Answering Network 
(SCAN) — to an examination of BARC and SCAN in the context of the 
existing reference referral system^ This system involves local public 
libraries and 17 System Reference Centers to which reference 
questions are referred before they are passed along to BARC and SCAN. 
The study focused on: (1) defining the nature of reference-related 
services provided by BARC, SCAN, and the System Reference Centers; 
(2) describing the major differences in reference services between 
EARC and SCAN and those of the System Reference Centers (e.g., unit 
cost, level of service); (3) determination of whether public 
libraries would be willing to allocate scarce resources to provide 
statewide access to information; and (4) the involvement of key 
stakeholders in the discussions and in the development of 
recommendations. In addition to a detailed discussion of the purpose 
of the study, its methodology, and the resources used, this report 
presents a summary of the findings, two models for reference referral 
that are proposed for a new organization structure, and a transition 
plan for the implementation of a new structure. Six tables and two 
figures are included in the body of the report, and ten survey tables 
summarizing data collected during the study follow the text. (KM) 
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I. INTRODUCTION AND SUHHARY FINDIN6S 



This study nas commissioned by Bary E. Strong, the State Librarian o^ Califor- 
nia. The findings and r ecoaaendati ons were developed in conjunction with the 
Select Co^'iittee on Super Reference, a five-member committee appointed by Mr. 
Strong. Thfe report distills the concerns and the perceptions of nearly 100 
key stakeholders who participated in the study through a group process. 

Public libraries are presently the conduit for local, state, and federal funds 
used to support reference referral and other reference-related functions in 
California, Therefore, when the term "reference referral system" is used, it 
is intended to imply reference referral through public libraries on behalf of 
the citizens of California. This report focus on the role of public libraries 
as the initiators and recipients of reference referral and on the need for 
statewide access to significant public library collections in the state. 

During the five month life of the study (February - June 1986) the scope was 
substantially redefined and broadened. It became clear that in order to as- 
sess the cost effectiveness and efficiency of the Bay Area Reference Center 
(BARC) and the Southern California Answering Network (SCAN), which was the 
original mission of the study, it would be necessary to examine BARC and 
SCAN'S performance in the context of the existing reference referral system, 
which involves local public libraries, and the 17 System Reference Centers 
(Reference Centers) to which reference questions are referred before they are 
passed along to BARC and SCAN. 

Furthermore, the study expanded to include not only reference (or "question 
handling"), but also three other reference functions which are performed by 
the System Reference Centers and BARC and SCAN: education and training, devel- 
oping specialized resources, and quality control. These four functions are 
funded out of limited state funds (presently $1.5 million from the California 
Library Services Act) and are therefore competing for the same resources. 

A study on reference referral in the State of California is broader in impact 
than the focus of the study might suggest at first glance. Underlying the 
discussion of reference referral are a cluster of issues which drive public 
policy. These issues all relate to questions of how much information to pro- 
vide to the citizens of California, how to access that information, how to al- 
locate it, and how much staff time to dedicate to the process. Once answers 
to these questions are reached, it will be possible to allocate scarce re- 
sources appropriately to each of the four reference functions. These deci- 
sions are basic to the formulation of sound public policy. This report pro- 
vides a good deal of information which can be used for making these decisions. 
It includes the following sections: 

0 Summary findings and recommendations; 
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0 Tno models for reference referral, Nhich are proposed for a new 
organization structure; 

0 Transition plan for isplepenting a new organization structure; study 
objectives and the change in the study's scope; 

0 Background to the problem; 

0 Description of the existing reference referral process in Cali f ornia; 

0 Description of both the process and the resources used to complete the 
study. 

0 Data Collection and analysis 



Definitions follow the introduction in order to provide the reader with the 
vocabulary that Has developed and used during the study process. Working hy- 
potheses, developed during the study process, which help to clarified issues 
underlying reference services are also included early in the docunent. These 
hypotheses contributed to the shaping of the suntnary findings and recommen- 
dations in the report. 

The Study Tables which appear at the end of the report sunnarize data collect' 
ed during this study from both BARC and SCAN and the 17 System Reference Cen- 
ters. These original data have been and should continue to be very useful in 
the decision naking process. The tables provide information on unit costs and 
the nix of resources available to provide reference referral. 

Public libraries draw on other than public library reference resources, and do 
not and should not ./xist in a vacuum. Subsequent identification and examina- 
tion of specialized information resources located in the state would be a val- 
uable follow-on to the study. The identification and use of these other re- 
sources, however, lies outside the scope of this study. It is assumed that 
the work of the California Networking Committee will dovetail with the study 
findings in the future, and that the new reference referral structure will 
become the first component of California's emerging multi-type library net- 
work. 



1. DEFINITIONS 

The following functions and terms were developed in the course of the study. 
They provided a common framework and a common vocabulary for discussion. Host 
of the definitions were developed in consultation with participants in the 
study process. Some of the distinctions and some of the terms are unique to 
this study. Sharing a common understanding of the meaning of these concepts 
has been integral to the study process, and is thus important for the reader 
as wel 1 . 



- 2 - 

9 



Since the delivery of reference service, through the process of reference re- 
ferral, is the focus of this study, it is important to define at the outset 
Mhat is «eant by the terms "reference," "reference referral," and "reference 
resources." Several teras are used to characterize different levels of re- 
sources provided for reference, or "question handling." The levels are: "gar 
den variety," "state-of -the-practi ce, " advanced-state-of -the-practice, " and 
"super reference." These concepts will be used throughout the report. 

Garden variety reference is outside the scope of this study; it is the pro- 
vince of local public libraries. Our focus is on the higher level reference 
referral services provided by the System Reference Centers and by BARC and 
SCAN, which support the ability of local public libraries to respond to refer 
ence questions from their patrons. 



1. 1 Basi c Terms 

Reference is a mediated service. It involves a patron, or library user, who 
has come, called, or written to the library with a question and needs help in 
finding an answer. The patron enlists the help of the reference staff, who 
attempt to bring the information and the patron together. The staff therefore 
mediate between the patron and the information resources required to handle 
the question. In this report "reference" is broken down into four functions: 
question handling, education and training, and developing specialized re- 
sources, and quality control. 

Question handling is what the library profession calls "reference." We use 
the term "question handling," and the term "reference" i nterchangeably, al- 
though question handling is only one of the reference functions that will be 
examined in this study (see below). We use the term "question handling" r:.- 
ther than "question answering" because not all questions received are ans- 
wered, and some of those that are answered have been referred to another 
source. Whether a question has been answered or not, resources have been 
spent in the process of handling the question, one of the issues that this 
study addresses. 

Reference Referral is reference service which results in staff at one library 
passing on a question to another library/resource in order to bring additional 
reference resources to bear. It is also called "interlibrary reference." 

Reference Resources are the combination of reference staff and information 
resources. Information resources include the reference collection, the per- 
iodicals collection, the government documents collection, the general collec- 
tion, as well as online data bases and resources which can be tapped by tele- 
phone, electronic mail, or conventional m.ail to access outside resources and 
expertise. The reference collection includes those materials which are housed 
in a designated reference area, such as reference books, and are so useful 
that they do not circulate. The general collection includes both fiction and 
non-fiction that circulate. 

Statewide access involves the delivery of an agreed-upon level of reference 
service to California library users in order to make reference service "equi- 
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table" throughout the state, regardless oi geographic location, wealth o-F 1 o-* 
cal jurisdiction, or size oi local library resources. Statewide access thus 
involves providing access to library and infornation resources, regardless oi 
where they are located in the state. By deHnition, statewide access implies 
a reliance on reference referral. 



1 .2 Reference Functions 

There are four oajor functions delivered by the Systen Reference Centers and 
BARC and SCAN. They are question handling, education and training, developing 
specialized resources, and quality control. 

Question Handling involves four levels of service. Each requires a different 
o)ix of reference resources (e.g., staff and infornation resources). There is 
usually a high correlation between the level of staff and the level of infor- 
mation resources. The experience, expertise, and anount of dedicated tifte of 
the staff characterize the level of staff resources available. Similarly, the 
range, depth, breadth, and currency of information characterize the Isvel of 
information resources available. Staff need and use information resources to 
a varying degree, depending on the level of question handling required. The 
distinction between the last two levels (ad vanced-st ate-of -th e-practi ce and 
super reference) is more a matter of degree than of kind. They really repre- 
sent points on a continuum, with one shading gradually into the next. 

Garden Variety Reference: Staff have sone reference training to handle 
questions. The time of the staff is not dedicated solely to reference, 
or necessarily to reference-related functions. Staff use information 
resources cosmonly found in a snail reference collection (i:.g., almanac, 
encyclopedia, unabridged dictionary). No data base searching and probab- 
ly no long distance telephone inquiry are needed. Earden variety refer- 
ence is outside the scope of this study since it is the province of local 
public libraries, not the System Reference Centers, or organizations like 
BARC and SCAN. 

State-of -the-Practi ce Reference: Staff usually have a Masters in Library 
Science (HLS), are trained to handle reference, and have some reference 
experience. Their time is not dedicated solely to question handling, or 
necessarily to other reference-related functions. Staff work Nith a mod* 
erately sized reference collection, periodicals collections, and general 
collection. They may have access to online searching for commonly-used 
data bases. They make moderate use of telephone inquiry for tapping out- 
side expertise and resources. 

Advanced-State-of -the-Practi ce Reference: Staff are very experienced 
professionals with HLS degrees and may have expertise in a subject area 
as well. Their time is dedicated solely to reference functions (largely 
to question handling and collection development). Staff Nork with very 
large collections — reference, periodicals, government documents, and 
general collection — which have depth as Nell as breadth and are up-to- 
date. They have online searching capability and search commonly held 
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data bases. They nake tioderatB, to extensive, use telephone inquiry 
for tapping outside expertise and resources. 



Super Reference: Staff are professionals with MLS degrees. They are very 
experienced and usually have subject expertise. Their tine is heavily 
dedicated to question handling, although they «ay engage in other refer- 
ence related functions to a liipited extent. Staff work with very large 
reference, periodical, governnent document (full depository), and general 
collections, or Hith a very specialized reference collection. They have 
funds available to access specialized as well as co«monly-used data bases 
and to nake extensive use of the telephone for tapping outside expertise 
and resources. 

Education and Training includes: (1) formal and informal training, such as 
workshops on a given subject (e.g., business, legal, »edical tools/tech- 
niques), on-site visits to see collections, as well as education at outside 
credit courses and (2) the development of tools that can be used to educate 
individuals to improve their performance (e.g., reference manuals, articles on 
reference service). 

Developing Specialized Resources involves two major activities; (1) creation 
of finding tools, and (2) collection development. 

(1) Creation of finding tools may be used only by the creator of the 
resource locally, or distributed to others. These tools are either (a) 
by-products of the reference process, such as the "info files" developed 
by BARC and SCAN, or (b) specially compiled lists of facts and data such 
as those published in Scan Updates, BALIS' telephone list of foreign 
language speakers, the guide to subject collections that SCAN published a 
number of years ago, and BARC Notes (BARC's monthly newsletter). 

(2) Collection development includes both the selection and purchase of 
naterials. Pertains primarily to the development of the reference col- 
lection, and secondarily to the development of subject collections in the 
general collection. It may be reactive (e.g., questions that cannot be 
answered with in-house materials may result in a decision to buy an item 
so that the same, or similar, question can be answered more quickly next 
time using in-house materials), or proactive (e.g., anticipating ques- 
tions in a given subject area). 

Duality Control involves either implicit or explicit performance standards 
relating to turn-around time, accuracy, completeness, and other variables. 
Implicit quality control suggests no formal standards for defining and mea- 
suring quality, but rather a shared definition of what is considered good 
quality. Explicit quality control requires formal definitions and measures of 
quality (e.g., The CLSB's requirement that the Systec efc?rence centers im- 
prove turn-around time by answering 70Z of referred questions within 10 days). 
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2. SUrihARY FINDINGS 



This section describes broad public policy issues, proposed organization 
structures, authority arri funding, governance and nanagement, as well as the 
need fora transition period to adopt the new structure. 

2. 1 Public Policy Issues 

At the end of the process, there Mas MAde agreeaent aaong the participants on 
a few key policy issues, as follows: 

(1) Mediated access to significant public library reference resources should 
be available to everyone in the state, regardless of geographic location 
(i.e., statewide access). 

(2) Reference referral should build on the existing public libraries with 
significant reference resources (i.e., strong central collections and 
r ef er ence staff ) . 

(3) Reference referral is a function that requires state support to build on 
local resources. It should be supported using state funds, such as those 
provided under the California Library Services Act (CLSA), not federal 
funds (i.e., the Library Services and Construction Act, LSCA) . 

(4) The ranking of reference functions should be; first, question handlings- 
second, by a wide nargin, education and training; third, developing spe- 
cialized resources; and fourth, quality control, which was viewed as im- 
plicitly included in the other three. 

(5) The amount of resources allocated to question handling at the super ref- 
erence level should be cut back, regardless of other cuts required by 
budget constraints. 

(6) The aDOunt of resources should be increased for the delivery of state- 
of-thG practice and advanced-state-of-the-practice reference service. 

2. 2 Organization Structure 

There was wide agreement among participants aboL!t a number of propositions 
concerning a new organization structure for reference referral. 

(1) The new structure ^should be regional. There should be a shift from the 
current hierarchical structure to a formal regional network structure, 
which allows for Bore lateral communication and specialization. 

(2) The structure should be based on using designated public library central 
collections as hosts to the Combined Reference Centers (hosts and centers 
to be selected in the implementation plan). 
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(4) The 17 existing System ReferencB Centers should be combined into a smal- 
ler number o^f regional centers which can build on existing re-ference 
strengths oi public libraries. 

(3) The number o^f Combined Reference Centers should not be determined at this 
point. That decision requires further analysis of the data collected 
during this study, as well as an assessment of additional variables (such 
as geographic coverage, increased communication and delivery costs 
resulting from consolidation, etc.). 

(4) The new structure should provide coordination among the new Combined Ref- 
erence Centers in order to improve efficiency. 

(5) The new structure should facilitate linkages with other non-public li- 
brary resources in the state (e.g., academic, special, school) to supple- 
ment public library resources. 

(6) The new structure should allow for flexibility and for change over time 
in response to the evolution of the emerging statewide library network. 

In the new reference referral system, the Combined Reference Centers will 
constitute the base of the structure and will continue to provide state-of- 
the-practice reference in rifsponse to questions referred from their member li- 
braries. Two possible organization models can be used to coordinate the work 
of the Combined Reference Centers: (I) a Modified Pyramid, and (2) Augmented 
Reference Centers. A third model, called the "supermarket model," was also 
considered in the study process. A summary of the discussion and the reasons 
why this model was not recommended for the overall design are given in Section 
6 below.* 

The choice between the two models depends on whether, and to what extent, it 
is desirable to provide super reference services. The range of other 
reference related duties and the amount of time ttiat will be allocated to each 
(e.g., education and training, developing specialized resources, and quality 
control) will be determined in the implementation plan. 



Model 1: Modified Pyramid 

In this organization structure, there will be one Super Reference Center which 
will provide super reference statewide. The Center will handle super refer- 
ence questions referred from the Combined Reference Centers, as well as pro- 
vide back up on state-of -the-practice and advanced-state-of-the-practice ques- 



*The supermarket concept can be used as an organizing principle for 
bringing supplementary resources to bear at the local and higher levels. A 
supermarket approach requires a mechanism for payment to information providers 
and is currently a viable option for System Reference Centers, as well as 
local public libraries. Nothing in the current, or proposed, organization 
structures prevents this kind of contracting. 
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tion handling Nhen the Conbined Reference Centers need help (e.g., a backlog 
oi questions, or staH vacancies). 

The Super Reference Center will be based ai the «ain library of the Los Ange- 
les Public Library (LAPL). It Mill be staffed by very experienced reference 
staff, Mho know the. LAPL collection well and bring subject expertise as well 
as experience to question handling. Their tine will be fully dedicated to 
super reference and related re-ference functions. 

The primary super reference resource will be the naln library of the LAPL, 
supplemented by LAPL branch collections. As the host, LAPL will receive ad* 
ditional state and/or federal funds to augment its reference resources. The 
Super Reference Center will access other public library collections in the 
state, as well as non-public library resources, both inside and outside of the 
state. 

The staff of the Super Reference Center will: (1) handle super reference (with, 
"caps'* on the amount of tine that can be spent seeking an answer); (2) provide 
back-up advanced-state-of -the-practi ce and state-of -the-practi ce question han- 
dling to the Combined Reference Centers; and (3) establish, maintain, and make 
use of linkages with non-public library reference resources for question 
answering. 

The staff may develop specialized resources on a f ee-f or-ser vi ce, or subscrip- 
tion basis. If the staff engage in education and training, it might be by 
contract with one or more of the Combined Reference Centers. It is assumed 
that basic reference training will be handled by the Conbined Reference Cen- 
ters. 



Hodel 2: Augmented Reference Centers 

In this model, there will be no super reference. Instead, a few of the Com- 
bined Reference Centers will be designated as Augmented Reference Centers. 
These Augmented Reference Centers will provide advanced-state-of -the-practi ce 
question handling on a statewide basis. They will receive additional state 
and/or federal funds to augment their host collections and enhance their ref- 
erence resources.^ The Augmented Centers will be expected to develop areas of 
specialization over tine, and therefore there will need to be a high degree of 
lateral communication among them to ensure resource sharing. 

The Augmented Centers will handle questions referred from the other Combined 
Reference Centers, including back up state-of-the-practice question handling 
as needed. Each of the Augmented Centers wiil also serve as a Combined Refer- 
ence Center for its own region, handling state-of-the-practi ce questions from 
libraries in its region. An open issue, to be decided in the implementation 
plan, is whether they may also handle questions referred dirsctly from public 
libraries outside of their regions. 



'Presently, the State Library augments the collections of all public li- 
braries in cities with populations over 100,000, using LSCA funds. 
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The Augmented Centers will be located in host public libraries with skilled 
re^ference staff, plus very large and highly developed central reference and 
general collections. The reference staff at the Aug»ented Centers will be 
very experienced professionals, who know the host collection well, and bring 
subject expertise as well as experience to question handling. Their time will 
be fully dedicated to reference-related functions. To suumarize, the staff 
will: (1) handle advanced-state-of -the-practice reference in response to 
referrals (with "caps" on the amount of time that can be reasonably spent 
seeking an answer); (2) provide state-of -the-practi ce reference to libraries 
in their own region (and, perhaps, from other regions); and (3) establish, 
maintain, and make use of linkages with non-public library reference resources 
in question answering. 



Model Comparisons 

While the two organization models differ significantly, both models are 
predicated on the existence of a number of Combined Reference Centers. The 
modified pyramid model resembles the current organization structure. Instead 
of two points on the pyramid, however, it combines the functions of BARC and 
SCAN into one Super Reference Center on top of a regionally based collection 
of Combined Reference Centers. As is the case now, there would be little 
incentive for lateral communication or much need for coordination between the 
Combined Reference Centers. 

In the second model, there would have to be a great deal of lateral communica- 
tion and coordination between the Augmented Reference Centers. Over time, 
they would develop separate areas of specialization, which would require coor- 
dination and a mechanism for referring questions to one another. Also, since 
the other Combined Centers (and perhaps other libraries) could access any of 
the Augmented Centers, one would expect some degree of competition to evolve. 
If an Augmented Center provided significantly inferior service, it would cease 
to receive questions, which would bring it under immediate scrutiny from its 
funding authority. 



2.3 Authority and Funding 

0 Authority for the delivery of statewide and regional reference referral must 
emanate from the state and be supported largely with state funds. 

0 The most logical source for the authority to set up such a structure is the 
presently unfunded Section 18760 of CLSA that refers to the establishment 
of one or more statewide reference centers. 

0 Allocation of funds could involve either reallocating some of the existing 
funding under the act which relates to reference, or obtaining new addi- 
tional funding through the state budget process. 
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0 In addition to base support from state funds, the functions oi the referral 
system could be strengthened through supplenental funding for targeted 
functions using a variety of sources, including local contributions, 
subscriptions, and contracts for services between inforaation providers. 

Prooraffi Budget 

0 The fiajority of available state dollars will be allocated to question han- 
dling. State funds Mill be used to: (1) cover the costs of reference 
staff Mhose tine is fully dedicated either to the super reference center 
located at LAPL or to the Augmented Reference Centers; (2) staff the 
other Combined Reference Centers; and (3) cover the costs of other 
resources associated with the delivery of high level reference by the 
Combined Centers. In either aodel, hosts would receive funding for col- 
lection devel opnent , building on their existing strengths. 

0 The regaining state dollars will be allocated to support: (1) education and 
training, and (2) developing specialized resources. 

0 The method, source of funds, and anount of compensation for help frofn non- 
public library reference sources in handling questions (such as the Uni- 
versity of California caftpuses, Stanford University, Cal Tech, and other 
academic, special, and school libraries) will be determined in the imple 
nentati on plan. 



2.4 Bovernance and Hanaoement 

While there was no direct discussion in the various meetings about governance 
there was considerable concern expressed dbout assuring local control, being 
responsive to local needs, and providing for the continuation of local and re 
gional representation. The new organizational structure would therefore 
require rules and regulations promulgated by the CSLB. The details of the 
governance structure must be included in the implementation plan. 

In every meeting, there was a widely perceived need for managing the flow of 
reference referral in the present system. In Bodel 1 (Modified Pyramid), as 
in the present system, the hierarchical structure maintains an upward flow of 
questions and thereby imposes a degree of coordination. Under model 2 (Aug- 
mented Reference Centers), with much more lateral communication, the need for 
management would be even greater. Therefore, to provide the necessary 
coordination and management: 

0 The State Librarian should hire an individual with proven management skills 
to join the State Library staff in a senior position to coordinate the 
new reference referral system. 

0 The coordinator would be responsible for a variety of duties, to be spelled 
out by the State Library together with the Implementation Task Force. 
These duties should include the following tasks: 
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-Coordinate f:he developoent and draUing oi policy and service priorities 
'for question handling, education and training, developing specialized 
resources, and quality control. 

-Monitor performance (staff and hosts). 

-Develop budget projections for service delivery, in conjunction with the 
State Library. 

-Coordinate linkages between Combined Centers and other non-public li- 
brary resources in the state, 

-Monitor the use of these non-public library resources and iftplement a 
reimbursement mechanism, if needed. 

-Assure coordination with other statewide networks and groups (e.g., the 
California Data Base, CLASS, and the California Networking Committee). 

-Analyze data collected during this study and identify gaps in data 
required to improve decision aaking. 

-Test the validity of key working hypotheses developed during the study. 



2.5 Transition to the U^u Structure 

There was widespread concern about interrupting present reference referral 
services, as well as concern about the inpact of change on existing staff 
(i.e., BARC, SCAN, and System Reference Center Coordinators and their staffs). 
The Co/nmittee recommends that there be a two year transition period, starting 
September 1986 and end September 1988 for the following reasons. It is impor- 
tant to make the transition from the existing system to the new reference net- 
work as smooth as possible, retaining the old structure while the new is being 
designed and implemented. It is also important to allow adequate time for 
those System Reference Center staff whose present center will be eliminated, 
as a result of creating the Combined Reference Centers, to have sufficient 
lead time to find other jobs. Furthermore, the recent serious fire at LAPL 
will delay the ability of LAPL to take up its role in the new network as 
either the deliverer of super reference (Modified Pyramid Model), or as the 
deliverer of advanced-state-of -the-practi ce reference (Augmented Reference 
Center Model). 



3. RECOHHENDATIDNS 

The 24 recommendations, which follow, address the issue of how best to deliver 
reference referral services through California public libraries to citizens in 
the state. The recommendations grew out of the study process, which involved 
nearly 100 people during an intensive five mor.th period (February 1986 to June 
1986). The recommendations represent the collective thinking of members of 
the Select Committee on Super Reference and the study consultant. 




Th9 study consultant and the Bembers oi the Select Committee propose that the 
recommendations be accomplished over a two-year transition period, starting 
July 19B6 and concluding June 30, 19B8. The proposed Transition Plan -Follows 
immediately after the recommendations. 

Transition Phase I provides for dissemination oi the study findings, review 
and comment from the field, and follow-up data analysis and data collection, 
if needed. Transition Phase II requires that an Iitpl enentati on Task Force Hork 
with newly-hired, management-level staff at the State Library to develop a de- 
tailed plan for a new organization structure for public library reference re- 
ferral in California. 

Dnce the details of the new organization have been spelled out, implementation 
of the plan can begin. The target date for inpleoientation of the plan is July 
19BB. Details of the i <ApI ementation plan will be worked out in Phase II of the 
transition plan. The development of the plan and its implementation, however, 
are not part of the scope of this study. To summarize, the timetable is: 

Transition Phase I: July 19B6 to December 31, 19B6 (six months); and 
Transition Phase II: January 19B7 to June 30, 19BB (eighteen months). 

3. I Droanization Structure 

The Consultant and the Select Coixnittee recommend that the State (either the 
CLSB and/or the California State Librarian):' 

1. Provide local public libraries with mediated statewide access to des- 

ignated public library reference resources (collections and staff). 
The intent is to provide equitable access statewide to public li- 
brary reference resources which can be used by reference staff to 
handle reference questions asked by Cal if orni ans, regardless of 
where they live in the state. 

2. Reduce the total number of system reference centers by combining the 

17 existing System Reference Centers into fewer, strong, regional 
centers to form the foundation of a new organization structure for 
handling reference referral by local public libraries in California. 

3. Formalize lateral communications between the Combined Reference 

centers by establishing protocols for the delivery of reference re- 
ferral to public libraries in California and clarify their role in 
either of the two organization models discussed above. 

4. Support the Combined Reference Centers with CLSA funds in order to 

provide mediated statewide access to designated reference resources. 
The Combined Reference Center staff will use their ''host" 
collection, as well as outside resources, to handle questions 



'The statutory authority for CLSA policy, funding, and programs resides 
with the CLSB. Administration of LSCA funding rests with the State Librarian. 
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referred by the local public library. Each Reference Center will be 
located in the sane building as its host central collection. 

5. Maintain the existing regional public library syste* structure out oi 

which Systems Reference Centers currently derive their operating au- 
thority and funding. Consequently, after the reorganization, there 
Mill be more Systems than Combined Reference Centers. 

6. Assure that Systems continue to support CLSA mandated reference re- 

lated functions, including "system-wide reference training," •'ser- 
vice to the underserved, " "general and specialized reference collec- 
tion development," and "improvement and maintenance of coordinated 
reference service support to the meabers of the System," such as de- 
veloping speci al i zed resources. 

7. Assure that Systems continue to support question handling by using 

CLSA funds for "employment of reference specialists," wherever 
these speciali sts' are based, regardless of whether the System's Ref- 
erence Center stays intact or is combined with other System Refer- 
ence Centers. 

B. Select a number of public libraries with strong central collections 
to serve as designated reference back-up to local public libraries 
in their region. Each library selected will also host one of the 
newly Combined Reference Centers. 

?. Provide the Systems with state funds to reimburse the host libraries 
to cover some, if not all, of the costs associated with being a host 
(e.g., indirect costs, such as rent, heat, light, and direct costs 
such as host staff assistance and supplies). 

10. Explore ways of acquiring additional funds to support collection 
development at the host libraries. 

11. Design and cost a formal organization structure for handling refer- 

ence questions referred from public libraries through the Combined 
Reference Centers, using one of the folloNing models: (1) the 
Modified Pyr^jnid Model and (2) the Augmented Reference Center Model. 

12. Encourage wide discussion by public library professionals in Cali- 
fornia on the merits of these models. Gain feedback on which model 
will work best in California. 

13. Request that the present System Reference Coordinators, and BARC and 

SCAN staff, meet to continue their preliminary June 19B5 discussions 
on collecting and reporting question handling data to the state li- 
brary. Ask that they make recommendations about the parameters of 
data collection in the future. Request that they expand their agen- 
da to include a discussion of such issues as: ''caps" whiJih would es- 
tablish flexible guidelines (not regulations) to limit the amount of 
time devoted to pursuing an answer; what constitutes a "reasonable" 
amount of time to ansner questions; productivity measures for ques- 
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tion handling (e*g«, measuring partial answers, negative answers, 
user satisfaction v&« professional reference librarian satisfaction, 
turnaround tine vs. completeness). 

14. Assure that guidelines for data collection and for Measuring output 

of question handling are developed. Leave the i npl enentati on of the 
guidelines to those reference librarians who are handling referred 
questions. Make no attempt to create formal regulations that set 
time limits per question handled. 

15. Select and announce the new organization structure to replace the ex- 

isting structure used for delivering reference back-up to public li- 
braries in the state. Prepare a press release that e«xplains factors 
influencing the final decision. 

16. Develop an implementation plan. 

17. Keep in place the existing reference referral pyramid (i.e., BARC and 

SCAN) during a two-year transition period while the System Reference 
Centers are conbined and the two possible organization structures 
are being discussed. 

IB, Use LSCA funds to support both BARC and SCAN in 19B6-19B7 and, most 
likely at a reduced rate, in 19B7-19BB (the percentage of reduction 
in funding should be specified in the implementation plan). 

19. After FY 19BB, use state funds, not f ederal (LSCA) funds, to supply 

local public libraries with supplementary reference assistance ei- 
ther up to the level of super reference, or up to the level of the 
advanced-state-of-the-practice reference (depending upon which model 
i s sel ect ed) . 

20. Encourage the Combined Reference Centers to strengthen their links to 

public and non*public library resources, both inside and outside the 
state, which have not been designated as hosts. Stress that local 
funds can continue to be used by Combined Reference Center staff to 
contract for services that supplement the use of designated host 
collections resources (the supermarket model). 

21. Request that system reference centers monitor, in a systematic way, 

their use of outside resources and report back to the public library 
community. The intent of this data gathering effort is to determine 
whether and to what extent other resources, which have not been de- 
signated as hosts, should be considered statewide reference resour- 
ces in the future and be compensated accordingly. Also request that 
the Centers report on the frequency with which they are contacted by 
outside public and non-public information providers and the nature 
of the inquiries they receive. 

22. Disseminate information on both the host and non-host library refer- 

ence resources, in order to promote use of these collections for 
question handling by local public libraries, and by the Combined 
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Re^ferencB Centers. LSCA funds Hould seem an appropriate source to 
fund this eHort. For exanple: 

(a) underwrite a plan for identifying and publicizing the availabil- 
ity of specialized resources located in libraries in the state 
(e.g., subject areas, fornatsy types of materials); 

(b) determine the cost and value of updating the files on library 
collections currently maintained at the System Reference Centers 
plus BARC and SCAN; 

(c) determine whether the software developed by the San Joaquin Val- 
ley Library System (SOVLS) should be transferred to other Reference 
Centers; 

(d) consider funding the development of an automated directory of 
specialized resources in the state, which will update the files kept 
by each System Reference Center, as well as by BARC and SCAN, and be 
available online and in hard copy. 

23. Coordinate with the members of the California Task Force on Multi- 

Type Networking in order to insure that the organization structure 
selected for public library reference referral fits comfortably 
within the structure of the emerging multi-type library network for 
California. 

24. Explore with the California Library Services Board (CLSB) and the 

Government Relations Committee (BRC) of the California Library As- 
sociation (CLA) strategies for funding the presently unfunded provi- 
sion in the California Library Services Act (CLSA) for the estab- 
lishment and administration of two or more state reference centers 
(Chapter 1, Article 6, Section 1B760). 



3.2 Transition Plan 

The study consultant and members of the Select Committee propose that the fol- 
lowing transition plan be implemented over a two-year period. The transition 
period should begin July 1986 and end June 30, 19B8. During this transition 
period, an implementation plan will be developed and some of the System Refer- 
ence Centers may begin to combine. The plan will put into place a new organi- 
zation structure for public library reference referral. This new structure 
will most likely be the first component of California's emerging multi-type 
library network. 

The State Librarian will ensure that both the members of the California Li- 
brary Services Board and members of the California Networking Task Force are 
kept apprised of activities during the transition and are involved as neces- 
sary in drafting and reviewing documents over the two-year period. 

The Transition Plan consists of two phases: Phase I, July 1986 to December 31, 
1986 (6 months); and Phase II, January 1987 to June 30, 198B (18 months). The 
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list oi recoffimended activities is not intended to be exhaustive, but rather to 
describe the tone and pace oi activities needed to take a snooth transition. 



Transition Phase I; July 19B6 - December 31. 19B6 (six nonths) 

The study consultant and the Select Committee reconmend that the State Li- 
brarian undertake the following actions: 

K Distribute this final report during the sunner oi 1966 to the fol- 
lowing indivi duals and organizations: the dir ect ors of all public 
libraries in California, including the present host libraries; the 
directors of the 17 system reference centers; the directors of BARC 
and SCAN; the directors of all the libraries who responded to the 
questionnaire for potential bests; the directors of the IS Systems; 
all those who attended the seven focus group Meetings and two re- 
gional meetings, including the recorders; and, finally, all members 
of the CLSB, the Select Committee, and the Ad Hoc Reference Commit- 
tee, and the CCPLS Committee on Third Level Reference. 

2. Request that the administrators of each public library meet with 

their reference staff to discuss the contents of the final report, 
and that they forward their connents on the recommendations and 
choice of models to the State Librarian by December 31, 1966. 

3. Underwrite the travel costs of the Select Committee on Super Refer- 

ence, who will travel in teams to each of the 15 systems (not their 
own), in order to answer questions about the final report. They 
will encourage feedback on the recommendations from system members 
prior to December 31,1986, and will handle the coordination, sched- 
uling, and advertising of these meetings. 

4. Summarize, in writing, the feedback from the field and report back to 

the community by early spring 19B7. 

5. Report orally and in writing to the CLSB at their quarterly meeting 

in winter 19B6 or spring 19B7 on findings from the field. 

6. Appoint an Implementation Task Force immediately to assist the State 

Librarian in making the transition to a new organizational structure 
and in developing an implementation plan. 

7. Use the data collected during this study on "hosf and "potential 

host" central collection resources (i.e., the collections and refer- 
ence staff) to recommend to the CLSB which System Reference Centers 
to combine, which to augment (if the Augmented Reference Center 
Model is selected), and what the maximum level of referral will be 
(super ref erence, or advanced-state-of -the-pr act i ce) . 

B. Collect additional data if necessary from published sources or 

through a short follow-up survey to the research conducted during 
this study. 
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9. Test the validity oi selected hypotheses, which were developed during 

this study and which will have an inpact on the decision making pro- 
cess prior to the inplenentation phase. For example, it would be 
useful to analyze the experience oi MCLS and SCAN using the UCLA 
collection (as a result oi the LAPL fire). Such a study Right con- 
sider: (I) whether a large academic library collection (UCLA) can 
substitute for a large public library collection (LAPL), rather than 
be a supplement to it; and (2) how long it takes experienced refer- 
ence librarians (MCLS and SCAN staff) to master a large collection 
Nith which they are unfamiliar. 

10. Request that System Reference Center Coordinators, and staff of BARC 

and SCAN, meet to discuss such issues as defining the appropriate 
amount of time for •'caps" in question handling, and collecting data 
for tracking question-handling productivity. 

n. Fund a proposal to identify specialized library resources in the 
state, as described in Recommendation 20 above, during Phase I. 

12. Interview candidates to join the State Library staff in a permanent 

position to oversee the new reference referral system, taking into 
consideration the need for an experienced manager in this position. 

13. Provide a high level of staff (both in terms of time and ability) to 

support such transition activities as: scheduling of briefing ses- 
sions in the fall of 19B6 by the Select Committee at each of the 15 
Systems; analyzing data collected during this study and identifying 
data gaps needed prior to decision making; collecting additional 
data if needed; testing the validity of selected working hypotheses 
which will have an impact in the implementation of the plan. If 
necessary, contract for staff support to ensure that there is no 
interruption in the proposed timetable, if the permanent position 
cannot be staffed immediately. 



Transition Phase II: Januarv 1987 - June 30, 19BB (IB Months) 

The State Librarian, with the assistance of the Implementation Task Force, 
will see to it that the following activities occur by the targeted dates. 
Combining System Reference Centers and drafting the implementation plan are 
intended to occur in parallel, since the newly created Combined Reference Cen- 
ters form the foundation for the new organization structure. 

14. Hire the candidate identified earlier as a State Library staff mem- 
ber to oversee the new reference referral system. He should overlap 
with the temporary staff hired during Transition Phase I to assure 
that there is no break in staff support to the Implementation Task 
Force and to the State Librarian (see also Transition Phase I, #12 
and »13). 




15. Gather and analyze additional data Hi needed) by Harch 1987 to fill 
infortation gaps concerning such decisions as: the identiHcation oi 
those System Reference Centers which will be combined; and the iden*- 
tification oi hosts ior the Combined Reference Centers. 

16. Begin prelininary work on drafting the implementation plan for the 
new organization structure (selection of the todel will have been 
made in Transition Phase I above) and disseminate the preliainary 
plan to the library community no later than June 30, 1987. 

17. Underwrite the travel costs of the Implementation Task Force who 
will meet with the 15 Systems to gain feedback on the draft imple- 
mentation plan and with others in the field during Phase II. 

18. Identify those System Reference Centers which are to be combined and 
set up a timetable for the process, in consultation with the CLSB 
and the 15 System Administrative Councils, by June 30, 1987. 

19. Encourage the Systems to begin the process of combining Reference 
Centers on or before June 30, 1987, in order to take advantage of 
opportunities such as staff vacancies. 

20. Revise the draft implementation plan based on feedback from the Sys- 
tems and others, by September 1987. 

21. Request that System Reference Center coordinators and BARC and SCAN 
staff report in writing on their efforts to define and quantify 
question handling for the purpose of measuring productivity (see Re- 
commendation 113 under organization structure above), by September 
1987. 

22. Disseminate the revised implementation plan and the recommendations 
from Reference Center coordinators (plus BARC and SCAN), which de- 
fine and measure question-handling productivity, by late fall 1987. 

23. Hold a hearing on the revised implementation plan and the findings 
presented by the Reference Center coordinators plus BARC and SCAN at 
the November 1987 meeting of the CLA. 

24. Edit the implementation plan a second time based on feedback from 
the field. 

25. Ask the Reference Center coordinators, together with staff from BARC 
and SCAN, to revise their report, based on feedback from the field, 
by early winter 1988. 

2b. Fund the creation of an automated directory of specialized library 

resources — both public and non-public — in the state, if findings 
in Transition Phase 1, 111, above so indicate. 




3,3 Working Hypotheses 



In the course o* the study, a number o* Norking hypotheses evolved. They are 
generalizations and, as with any generalizations, there will alNays be excep- 
tions to the rule. Many oi them are important to the conclusions reached in 
the study and most of them merit further study. They were discussed and re- 
fined during the series of meetings by the participants in the group process. 
While many of these hypotheses have not been formally tested, the participants 
found them useful to provide a ba^is for discussion of overall reference qual- 
ity and service delivery capability. 

The concepts presented in the hypotheses refer to reference service at the 
state-of -the-practice level and above, not at the garden variety level. The 
concept which everyone agreed on is that reference is most efficient when 
staff and information resources are in close proximity. 

The hypotheses are: 

1. Host of the tiae, public library questions are best ansnered by 
using public library collections. 

2. Academic and special' library collect* s supplement a public library 
collection; they are not a substitul 'f given a choice between 
using a very large academic library • jc :)s UCLA) and a very large 
public library collection (such as LAPl) to answer all public li- 
brary reference questions, most participants would choose the public 
1 ibrary collection. 

3. Reference librarians can answer more questions using a very large 
public library collection (e.g., LAPL, SFPL) than using a **moder- 
ately sized" public library collection, provided that they are fa- 
miliar with the large collection. 

4. Reference librarians consult their reference collection as the first 
line of attack, followed by the use of other information resources, 
both inside and outside the library. 

5. The bigger is the general collection, usually the larger is the ref- 
erence service budget (the budget includes acquisitions for all ref- 
erence resources including staff, telephone, and data base search- 
ing). 

6. The bigger the overall collection (reference and general collec* 
tions), the more skilled the staff. The bigger the collection, the 
better the career path for reference librarians, the more they 
learn, the more expert they become. 

7. The bigger or more specialized the central collection, the aore 
likelihood of having reference librarians with specialized subject 
expertise, i.e., professional staff who are responsible for a par- 
ticular subject area and are expected to perform only reference du- 
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ties. In general, a high degree oi expertise can only be achieved 
in a specialized collection, regardless oi size. 

B. Specialization of staff and collection improves performance overall. 

9. The bigger the collection, the bigger and iiore skilled the staff, 
the higher the cost of delivery of reference at all levels (from 
garden variety to super reference). 

10. The result of low cost reference service oay be either low quality, 
or a greater reliance on referral to other resources. The less 
invested in reference service, the lower the service level. 

11. Reference librarians answer questions better if they can confer with 
other reference librarians about search strategy and reference 
resources --two heads are better than one. 

12. Experience improves performance. 

13. The greater the expertise of the reference librarian, the higher the 
quality and level of service. 

14. Expertise is not necessarily a function of experience. 

15. Learning to use a very large collection takes time. Therefore put- 
ting a reference stringer in a very large collection in order to 
gain access to a collection is less efficient than using the staff 
that come with the collection. 

16. The more layers in a referral network, the longer it takes to get 
questions answer ed. However, telecommunications (e-mail, for ex- 
ample) should improves elapsed time for question handling. 

17. Geographic proximity is not essential either for conveying the 
reference question or for delivering the answer. 

IB. Geographic proximity leads to familiarity with local constraints and 
roference climate, and results in reference service which is more 
responsive and accountable to the local library. 

19. Geographic proximity makes it easier to establish strong personal 
links and so gain feedback, tailor service, be more responsive, and 
evaluate performance. 

20. Geographic proximity may facilitate education/training and coopera- 
tive collection development, because of the knowledge of local con- 
strai nts. 
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II. CONTEXT, SCOPE, AND METHODOLOGY 



This part of the report describes in wore detail the institutional and policy 
environments, the scope of the study and how it changed during the project, 
and the aethodology used (e.g., the group process and the underlying analytic 
f ranework) . 



4. INSTITUTIONAL ENVIRONMENT 

This section describes the existing systeu of reference referr^^i in the state 
of California and the public-library-based institutions charged with deliver- 
ing reference referral in the state. These institutions are; (1) the System 
Reference Centers (hereafter referred to as Reference Centers), which are lo- 
cated for the most part in a "host" public library; (2) the Cooperative Li- 
brary Systems (hereafter referred to as Systems), which operate the Reference 
Centers; and (3) the Bay Area Reference Center (BARC) and the Southern Cali- 
fornia Answering Network (SCAN), which are located in the «ain libraries of 
the San Francisco and Los Angeles Public Libraries, and provide reference 
back-up to the Reference Centers. The reference resources available to these 
institutions, including their own staff resources, are described below. Their 
respective sources of funding are also described. 



4, 1 The Existing Reference Referral System 

There are three levels of reference in the present system: reference at the 
public library level; reference at the Systea Reference Center level, formerly 
called "second 1 evef r ef er ence; " and reference at the lavel of BARC and SCAN, 
formerly known as "third level reference." The following is a description of 
the flow of a reference question through the reference referral system. 



Path of a Reference Question 

A reference question is posed by a patron at the local level. It then nay be 
referred to one of the 17 System Reference Centers and then, if the question 
is still not answered, it may be referred by the Reference Center to two orga- 
nizations at the top of the hierarchy: BARC and SCAN. Figure 1 shows the path 
of a question through the referral system in California. By and large, the 
flow is up the hierarchy, although there is some informal lateral communica- 
tion between libraries and Reference Centers at the same level. 

At the local level, public libraries receive reference questions from their 
patrons. In FY 1985, they received 35 million queiiions. Most of the ques- 
tions they answered by using their own local reference resources, or by con- 
tacting other outside information resources directly. If they needed help, 
however, they knew that they could tap a higher level of reference resources 
by referring the question to their System Reference Centers. 
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In FY 1985, the 16V public libraries in California chose to reier 33,000 ques- 
tions! to one oi th:* System Reference Centers (see Table I). Both Table 2 and 
Figure 2 show the location of the Reference Center being used presently by 
each Syst^flir these 33,000 questions, representing about one-tenth of one 
percent of 1.jtal public library questions, are a major part of the focus of 
the study. 

In FY 19B5 the Reference Center staff handled 29,000 questions on their own. 
In their judgment, however, 127. (4,000 questions) required help from their 
back-up "third level reference" service --either BARC or SCAN, depending on 
whether they were in the North or South of the state. When BARC and SCAN re- 
ceive the referred questions, they are the reference resource of last resort. 
They either answer the question or return it if they cannot provide an answer. 
Either way, they provide a paper trail to the Reference Center to show how 
they handled the question. They assign the questions to staff and conduct 
what BARC describes as a "triage procedure": 

"They sort reference questions upon arrival. Incomplete questions 
will be returned the same day for clarification, and questions that 
can be answered quickly from BARC's Information File or other readi- 
ly identified sources will be worked on immediately by the "triage" 
off icer.*» 



Observations on the Referral Process 

Before describing the System Reference Centers and BARC and SCAN in more de- 
tail, there are a number of observations about the referral process, in 
general, and about BARC and SCAN in particular, that were made by participants 
during the study process. The fact that the comments focus on BARC and SCAN 
rather than on the Reference Centers reflects the original mission of the 
study, which was limited to an assessment of BARC and SCAN. Some of the key 
observat i ons were: 

0 It takes questions a long time to go through the hierarchy. 

0 There is little or no checking back with the patron as the question is 
referred, which raises the risk of spending more time than necessary 
(information overkill), or having misinterpreted the question. 

0 BARC and SCAN are widely perceived as spending too much time on answer- 
ing questions, on average. 

0 BARC and SCAN set high implicit standards for other reference producers 
through their example. 

0 BARC used to provide excellent training, but only in a limited geogra- 
phic area. 



»BARC, LSCA Proposal, FY 1987. 
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TABLE 1: California Cooperative Library Systems: Background Information (FT 198A-1985) 





Gunerul Iiilomiatlun 




Kaiikiii 




(1) 

Syitei 


(2) 
Population 
Servud 


(3) 

Hout Library 


(4) 
Queatlona 
Received 


(5) 

I answered 
in-Bybtent 


(6) 
local $ 


(7) 
Bliare of 
CLSA $(KL'f.) 


(8) 

1 Bliure of 
CLSA $(Ref.) 


(9) 
Cul. k 
ijUL'stlon 


(10) 
Col. 5 
AnBuera 


(11) 
Col. 7 

CLSA $ 


BALIS 

Black Gold 
49/99 


(in 1,000b) 
2,507 
955 
930 


Oakland PL 
Sta. Barbara PL 
Stockton Co. 


1,144 
1,633 
1,606 


90 
68 
79 


$19,630 


$108,220 
69,565 
64,303 


hn 

4.7 
4.3 


11 
6 
7 


2.5 

4 

7 


4 
11 
13 


Inliod 

HCLS 

NOBAC 


1,7^ 
5,009 
519 


River a Je Co. 
LoB AnReleB PL 
Salinaa PL 


3,406 
9,346 
1,069 


73 
93 
76 


— 


110,549 
253,749 
59,854 


7.5 
17.0 
4.0 


2 
1 

13 


1 1 
I 

8 


1 
J 

1 

15 


Mt. Valley 
Hortb Bay 
No. SCite 


1,401 
997 
601 


SacraiKnto 
Sonoma Co. 
Butte Co./Eure- 
ka/Shaeta Co. 


1,440 
978 
2,445 


71 
52 
50 




102,960 
98,642 
69,827 


/•U 

6.7 
6.1 


10 
14 
4 


12 
13 
14 


5 

J 

6 
9 


PLS 

SJVLS 

Santiago 


m 

961 
2,067 


San Mateo PL 
Fresno Co. 
Orange Co. (GO) 


1,458 
2,925 
65' 


80 
64 
40 


ti9,450 


61,573 
65,450 
97,118 


4.2 
4.4 
6.6 


9 
3 

15 


6 
5 

15 


14 
12 
7 


Sena 

So. Bay 
So. SUCe 


2,143 
1,394 
3,205 


San Diego PL 
San Joae PL 
Norvalk Regional 

1 


2,105 
1,115 
1,566 


74 
90 
75 




119,496 
83,990 
96,248 


B.l 
5.6 
6.5 


5 
12 
B 


10 

2.5 

9 


2 

10 : 
B ' 


Total 


25,053 




33,094 


mm 


$69,080 


$1,461,552 


1002 









Notes: 



This table was prepared by James Hanson, Library Developraent Services, California 
State Library, 

Total revenue for reference including local dollars and CI^A coraes to $1,550,632. 
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TABLE !• Background Information (continued) 
INCOME SOURCES FOR CLSA SYSTEMS FY 1985/86: From System Uniform Budget Reports 



All System Programs 





State 


Federal 


Local ** 


Total 


SYSTEM 


(a) 
CLSA 


(b) 
*LSCA 


TBR{c) 
(from CLSA) 


Local (d) 
funds/fees 


(e) 
Interest 


***(f) 
Other 


Total (g) 
Budgeted •. 


BALIS 

Black Gold 
49/99 


$ 186,543 
140,697 
137,393 


46,005 
72,898 
32,175 


96,331 
44,401 


52,048 
722,413 : 
40,192 


12,444 
24,522 


4,942 
40,048 


301,982 
1 ,u9d ,yuy 
254,161 


Inland 
MOBAC 


251,340 
An? m9 

131,056 


39,283 

3 1,01/ 

27,836 


119,338 
36,000 


80,748 
135,408 
32,214 


116,781 
1,796 


68,879 


676,369 
594 037 
228,902 


Mt Valley 
No. Bay 
No. State 


227,109 
219,603 


20,449 
60,059 


8,000 
132,887 


131,050 

'3QQ 1QQ 


20,000 


fil 7nn 
18,149 


406,608 
7RR R27 
430,698 


PLS 

Santiago 
SJVLS 


121,392 
151,790 
166,613 


30,616 
56,111 
35,523 


169,858 
75,000 


711,970 
568,657 


25,111 
20,000 


136,293 
101,238 


1,170,129 
334,250 
865,793 


Serra 
So. Bay 
So. State 


235,403 
158,825 
163,940 


44,470 
43,101 
20,397 


. 70,000 
31,113 


12,300 
50,025 
251,696 


6,000 
3,000 


60,535 
108,652 
22,600 


428,708 
394,716 
458,633 


• TOTAL 


2,902,820 . 


625,229 


830,720 


3,187.000 


260,996 


623,036 


8,429,802 


REVENUE BUDGETED TO REFERENCE 


BALIS 

Black Gold 
49/99 


112,297 
71,652 
67,033 




5,284 


18,622 
1,624 


1,258 




112,297 
96,816 
68,657 


Inland 

MCLS 

MOBAC 


115,172 
261,186 
61,929 












115,172 
261,186 
61,929 


Mt. Valley 
No. Bay 
No. State 


106,514 
106,942 
88,964 












106,514 
106.942 
88,964 


PLS 

Santiago 
SJVLS 


63,634 
103,146 
93,892 




35,000 


8,064 


14,000 




64,634 
103,146 
150,956 


Serra 
So. Bay 
So. State 


123,433 
97,498 
100,295 










5,937 


129,370 
97,498 
100,295 


TOTAL 


1,573,587 




40,284 


28,310 


15,258 


5,937 


1,666,376 ' 



* System Administration only. Total LSCA for all system projects is $1,863,455 
■ ** local total (c-f) is $4,901,753 ■, x • 

*** "Other" includes awards from other agencies, unexpended balances from prior year, e 
O (not allocated to columns c-e) 
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TABLE 2: LIBRARIES HOSTING SYSTEM REFERENCE CENTERS, BARC AND SCAN 

(1986) 



Host Library 

Butte County Library 
Eureka-Humboldt County Library 
Fresno County Free Library 
Los Angeles County Library - 

Norwal k Regional Library 
Los Angeles Public Library 



Resident System Re-ference 
Center /BARC/SCAN 

North State Cooperative Library System 

North State Cooperative Library System 

San Joaquin Valley Library System 

South State Cooperative Library System 



Metropolitan Cooperative Library 
System 



Los Angeles Public Library 

Oakland Public Library 

Orange County Public Library 

Garden Grove Regional Branch 

Riverside City & County 
Public Library 

Sacramento Public Library 

Salinas Public Library 

San Diego Public Library 

San Francisco Public Library 

San Jose Public Library 

San Mateo Public Library 

Santa Barbara Public Library 

Shasta County Library 

Sonoma County Library 

Stock ton -San Joaqui n County 
Public Library 



Southern Cali-fornia Answering Network 
Bay Area Library Information System 
Santiago Library System 

Inland Library System 

Mountain Valley Library System 

Monterey Bay Area Coop. Library System 

Serra Cooperative Library System 

Bay Area Reference Center 

South Bay Cooperative Library System 

Peninsula Library System 

Black GDld Cooperative Library System 

North State Cooperative Library System 

North Hay Cooperative Library System 

49-99 Cooperative Library System 



CALITOENIA OOUNTIZS WITH BTABUSHED IIBRARI ElSTiHS B»EF1TIHG IBOM THE 
CjOIfOilNlA LIBRARY SERVICES ACT 

FIGURE 2 




Tniund Library 



Metropolitan Cooperatly " Library Systen 
Santiago Library Systam^ 



Serra CooperatiTe Lib rary System 
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o BARC and SCAN both publish excellent tools, which should be continued, 
i'f necessary on a subscription basis (e.g., Scannings , SCAN Updates , 
and BARC Notes) . 



0 BARC and SCAN suffer from a lack of management --good reference librar- 
ians do not necessarily make for good managers. This is a result of 
the requirement that all BARC and SCAN staff be drawn from their 
hosts' reference staff. 

0 BARC and SCAN staff skills are strong because of their past experience 
as staff members of the host library and because of their continuity 
in their respective jobs. 

o BARC and SCAN services are very expensive because of their seniority on 
hosts' staff. They, unlike the Reference Center staff who are 
independent of the host library, are on the payroll of their hoEt 
library. Because of their seniority they are at the top of the pay 
scale. 

0 Some of the Reference Centers are located in resource poor areas, and 
consequently are not equipped with adequate reference resources. 

0 Reference questions which are referred to BARC and SCAN are complex, 
difficult, and therefore time consufning. They require very exper- 
ienced staff and sophisticated resources in order to find answers. 

Based on these observations, we coined the term "super refe 'nu' for the ser- 
vices provided by BARC and SCAN. The tern is intended to chj -^^.^rize the 
level of reference resources needed to answer these super reference questions 
(see Definitions at the beginning of the report). As we examined the flow of 
a reference question nore closely, it became evident that not all questions 
referred to BARC and SCAN are complex and require "super reference" resources. 
There are several reasons why this is so. 

Not only questions requiring super reference^ or even advanced-state-of-t he- 
practice resources, are referred up the hierarchy. State-of-the-practice and 
even a few garden variety questions, we suspect, are included in the 33^000 
ref err ed questi ons.* 

Firsti determining which questions to refer requires professional judgment, 
and a judgment call on whether to try to answer the question locally or to 
refer it. This decision is comparable to a make/buy decision in the market- 
place. What is considered worthy of referring by one local library or one 
Reference Center may be considered manageable by another, depending on profes- 



^Mhile we do not know the percentage breakdown of these questions by the 
four levels of question handling, we do have anecdotal information from 
reference librarians at all three levels to support this conclusion. There 
was interest in determining what the breakdown was for the 4,000 questions 
handled by BARC and SCAN (see the Section on Data Collection). 



sional judgment coupled with the level oi reference resources available in lo- 
cal libraries, and there'Fore, to the Systen) Reference Centers. Consequently, 
there is bound to be variation in the types oi questions which are referred. 

Secondly, the amount of time available to the staff at the reference desk has 
an impact on referral. Whether staff time is fully dedicated to question han-- 
dling or not, demand at the reference desk often exceeds the capacity of the 
reference staff. Rather than put aside a question because of time con-- 
straints, or ration reference by setting ''caps" (tine liaits), the reference 
staff may choose to refer the question to the System Reference Center, which 
may, in turn, refer the question to either BARC or SCAN, in hopes that an an- 
swer will be provided more quickly as a result of the referral. In this sce- 
nario, BARC and SCAN provide an extra pair of hands* They do work at the 
state-of -the-pr acti ce level which the 17 System Reference Centers are expected 
to perform. 

In order to understand the institutional environment it is inportant to review- 
some background. The origin of the System Reference Centers and the Systems 
(their parent organizations) is described below, as are their sources of fund- 
ing. A parallel discussion follows on BARC and SCAN. 



4.2 The Systems and the System Reference Centers 

The public library reference referral system in California has evolved over 
the past twenty years. Systems were established under the Public Library Ser- 
vices Act (1963), and continue to exist, although with changed geographic 
boundaries, under the California Library Services Act (CLSA, 1978). There are 
presently IS Systems (see Table 2 and Figure 2). 

The public libraries are members of the Systems and receive CLSA funds from 
the state through a formula which they spend on their System. The member pub- 
lic libraries also contribute local funds to support their Systems and, in 
some cases local funds are contributed to augment the state funds for refer- 
ence services. The body who administers CLSA is the California Library Ser- 
vices Board (CLSB). 

Until recently, Systems also received federal funds under the Library Services 
and Construction Act (LSCA), which were used to support system administration. 
The State Librarian is phasing out that support over a five-year period, which 
has caused the Systems funding difficulties during the transition. They have 
had to turn to their local menbers for more support and have had to cut back 
on some services. Some System Reference Centers have also been affected by 
this reduction in funds. 

CLSA requires the public libraries to spend their CLSA funds on specified ser- 
vices, all of which relate to resource sharing among public libraries* CLSA 
is the only legislation in the state which requires that libraries spend funds 
on particular activities (categorical funding). Public libraries also receive 
unrestricted funds from the state under the Public Library Foundation (PLF). 
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Last year, the ot«l 'er %'j million oi CLSA ^unds to Sy5teii,5. 11.5 

million Has earmarhnJ 1 oi "ttiL improvement and maintenance oi coordinated ref- 
erence support." The Act also enables 4und5 to be spent by the Systems for 
"system-wide reference training" and "general and specialized reference col- 
lection development." 

The "employment oi reference specialists" is an option, not a requirement, un- 
der CLSA The accompanying regulations to CLSA state that each System shall 
use its reference allowance to provide the following three service components: 
(a) general improvement of local reference services; (b) improvement of refer- 
ence services to the underserved; and (c) interlibrary reference. The CLBB 
has developed regulations "to set uniform performance objectives" for the 
Reference Centers. They require that 90'/. of the questions received by each 
System from their local library members must be answered. Seventy percent of 
these questions must be answered within 10 days. 

There is, however, no requirement that the Reference Centers try to answer the 
questions first themselves. If a Reference Center chose to, it could refer 
all of its questions to BARC or SCAN for answers. It might run into problems, 
however, in meeting the turn-around time requirements. 

While service to the underserved is one of the required service areas for the 
Systems, this study does not examine the provision of reference service to the 
underserved. It was not within the scope of this study to determine which ca- 
tegories of the general public use and/or benefit from reference referral. it 
should be noted, however, that the term "underserved" is interpreted in a va- 
riety of wavs. A number of the Systems, located in rural or underpopulated 
areas of the state, perceive that many or all of their patrons fall into the 
category of underserved. 

Since Reference Center staff in many Systems divide their time between CLSA 
mandated reference-related functions and System functions, it is important to 
list the other System services: 

Transaction-based reimbursements to compensate local public libraries for 
equal access (providing reimbursement for direct access to thsir local 
collections by patrons from outside their jurisdiction) and for interli- 
brary loan transactions; 



(1) 



(2) 



(3) 



Communications and delivery to support the exchange of materials and in- 
formation among member libraries; 

Planning, coordination, and evaluation of the overall system wide services 
as authorized by the Act; 

(4) Administrative Council and Advisory Board activities, including adminis- 

tering the System, adopting a System plan of service, preparing a propos- 
al annually to the CLSB for funding to implement the plan; and 

(5) Special service programs delivered by the local public library or by the 

System. 
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As discussed earlier, the provision of reference requires the combination oi 
Btaii and information resources. They are discussed below. 



Reference Center Staff 

Survey Table W shows the composition of staff at the Reference Centers: the 
number of staff, years of training, past experience, years working at the Ref- 
erence Center. Most of the Systems have chosen to hire their own trained ref- 
erence staff to handle the referred reference questions, although CLSA does 
not require them to do so. A few, such as Santiago Library System, have ex- 
perimented with a variety of arrangements, including contracting for reference 
services from another public library or from an information broker. ° 

Survey Table IV shows that «ost Systems have three or fewer professional staff 
at the Reference Center. The exceptions are MCLS with six, SJVLS with five, 
and Serra with four. Reference Center staff averaged six years of prior work 
experience at their host prior to joining the Reference Center. Only 
Reference Center staff in MCLS, Serra, and SJVLS had previously worked for 
their hosts for any substantial period of time. 

In many of the Systems, the Reference Center staff divide their time between 
reference functions and CLSA-r equi red System functions. The staff are employ- 
ees of the System, not of the host library. They report to the System Direc- 
tor and the Advisory Board of the System's Administrative Council and their 
salaries are independent of the pay scale at the host library. 



Reference Center Information Resources 

Reference Centers budget their reference funds in a variety of ways to deliver 
reference-related services. In our survey, the Reference Centers were asked 
to allocate the CLSA and local funds they receive to the four reference 
functions as we have defined them: question handling, education and training 
combined with quality control, and developing specialized resources. 

The Centers were asked to report their expenditures for FY 19B5 by reference 
function in the following line items, which summarize the type of resources 
that the Centers have: total salaries and benefits for all staff (support, 
professional, and contract labor); other direct costs (telephone and data base 
searching, purchase of reference materials for the host and/or for the Center, 
supplies and equipment); and the indirect rate. 



^Santiago has tried a variety of arrangements, including contracting with 
SCAN to have SCAN handle all the referred questions it receives. When SCAN 
raised their charges, however, Santiago did not renew the contract. Instead, 
it went back to using SCAN for reference referral only. However, Santiago 
continued to refer a wide variety of questions, taking advantage of the fact 
that SCAN was available and could be used free. 
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Survey Table II chows that, on average, Reference Centers spent 64'/. oi their 
resources on question handling, 107. on education and training and quality con- 
trol, and 117. on developing specialized resources. Over 177. oi expenditures 
fell into an "all other" category, which is undefined. 

Every Reference Center had funds for data base searching and allocated tele- 
phone costs to question handling (some included Dntyme, tUiz electronic (nail 
service), but some spent nuch nore than others (see the attached Survey 
Tables). All Reference Centers purchased reference (naterials either for the 
host (about half the Centers) and reference materials for use in the Center 
office (about half the Centers). 

Most of the Reference Centers naintain "info-files" in their offices which 
provide them with lists of information providers to contact. Some maintain a 
file of answers to frequently-asked questions, such as songs, poems, and auto- 
mobile repair information. Their files, however, are evidently small in com- 
parison to those of BARC and SCAN (see discussion below). 

Some of the Reference Centers have expanded their base of reference resources 
by sending their staff to other collections as stringers, or paying the staff 
at other collections to provide back-up reference on demand. These arrange- 
ments vary in formality and frequency, but have been cut back overall because 
many Systems have cut back on Reference Centers' activities. In addition, 
several of the Systens have set up multi-type networks. These networks permit 
libraries of all types (academic, special, and school) to work together with 
the Reference Centers on a variety of projects, and to share reference re- 
sources. For example, South Etay Cooperative Library System has a multi-type 
network, caDed SouthNet. BALIN is the multi-type network of the Bay Area 
Library and Information System (BALIS). North Bay has included school and 
academic librBries as full administrative participants in its Systbm Board of 
Di rector s. 



Reference Center Services 

The Reference Centers offer a variety of reference services to their menber 
libraries. Clearly question handling leads the list with 64'/. of their re- 
sources dedicated to that function. Education and training and developing 
specialized resources are tied at approximately 107, each on average. Refer- 
ence Centers hold workshops on reference for their members, publish newslet- 
ters, produce union lists and directories, and develop other finding tools. 
Many also advise their hosts on collection development. Over thp years, SDt?,e 
of the Reference Centers have become stronger than others in k-v. . fring these 
and other reference-related services. As a result, these str^ii^ deference 
Centers have become less dependent on BARC and SCAN for question handling and 
education and training, although all the Reference Centers place a high value 
on the specialized resources developed by BARC and SCAN ("info files," news- 
letters, and directories). 



- 27 - 




EKLC 



Refergnce Center Arranoenients With Hosts 



Table 2 shows the list of Reference Centers and their corresponding hosts. 
Three Systems have slightly different hosts arrangements. North Bay Library 
Cooperative System owns its headquarters, which are located across fron) the 
Sonowa County Library's headquarters. Monterey Bay Area Cooperative Library 
Systferfi is based in a mefnber community college. North State Cooperative 
Library System has three public library hosts for three Reference Centers, 
because of the paucity of reference resources in this sparsely populated 
portion of the state. They are: Butte Information Center, Shasta Information 
Center, and Eureka-Humboldt Information Center. 

Some hosts make use of the Reference Center staff in return for their contri- 
butions of space, equipment, and administrative support services. It is not 
appropriate, however, to use Reference Center staff to cover the host's refer- 
ence desk. Apparently a number of hosts engage in this kind of practice as 
compensation for being hosts. It would be far better to compensate the hosts 
for their in-kind contributions through direct reimbursement (see Recommenda- 
tions at the beginning of the report). Survey Table VIII si.ows that hosts 
(including the hosts to BARC and SCAN) presently incurred nearly $400,000 in 
direct and indirect costs because they hosted the System Reference Centers in 
FY 19B5. 



Host Resources Available to the Reference Center 

Reference resources available from the hosts (i.e., staff and information re- 
sources) are critical to the work of the Reference Centers, Since Reference 
Centers do not have collections of their own, apart from some ready reference 
materials, they are dependent on their hosts' collections, which is why their 
location physically with a host collection is so important. In several Sys- 
tems there are several designated host collections in targeted subject areas. 
Some of the Reference Centrr funds in those regions are spent on enhancing 
these subject collections for the benefit of all the members, via the use by 
the Reference Center staff. 

The hosts' resources vary considerably, as Survey Table VIII shows. All IB 
"host" libraries completed the survey form, including the hosts for BARC and 
SCAN.* These data were collected in order to gain a sense of the order of 
magnitude of each host's central collection and the size and background of 
their staff. At the same time that hosts completed the survey, 16 other li- 
braries were identified which had large central collections and were included 
in the survey, as "potential" hosts (see Table 3 as well as Survey Table IX). 

The strength of reference staff should be a significant factor in selecting 
hosts, since the reference staff are a real resource to the Reference Centers. 



*HhilB there are 17 Reference Centers plus 2 super reference providers 
(BARC and SCAN), there are IB host libraries if BARC and SCAN's hosts are 
included. The reason that there are not 19 hosts is that Los i-yeles Public 
Library hosts both SCAN and the MCLS Reference Canter. 
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TABLE 3: LIBRARIES RESPONDING TO POTENTIAL HOSTS' SURVEY: PUBLIC LIBRARIES 
WITH SPECIAL COLLECTIONS AND BRANCHES 



t Alameda County Library 
Berkeley Public Library 
Halifornia State University * Chico 
Jontra Costa County Library 
Glendale Public Library 
Kern County Public Library 
Long Beach Public Library 

Los Angeles County Public Library 
I The Afro-American Center at 
I The C4I i -f or ni ana Collection 
I The Chicano Resource Center 

Carson Regional Library 

Huntington Park Library 

Lancaster Library 

Montebel lo Library 

West Covina Library 

Oakland Public Library 
I Asian Branch 
I Latin American Branch 

Orange County Public Library 

I San Juan Capistrano Regional Branch and 
I Mission Viejo Branch; 

Pasadena Public Library 

I San Bernadino County Library 

San Diego County Library 
% El Cajon Library 

I San Mateo County Library 

I Santa Clara County Free Library 

Stanislaus County Free Library 

Torrance Public Library 

Tulare County Free Library 

I Ventura County Library. 

Notes; 

North State Cooperative Library System requested that CSU - Chico be included 
in the survey. North State has been experimenting with using that collection 
as a reference resource. 

Libraries and collections marked with an asterisk (I) were excluded in the 
data analysis because the collections were £ ^her too small or too special- 
ized. 



Conpton, 
and 

at Montebel 1 0 
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The hosts' reference staH knoN their collection and can be oi use to the Ref- 
erence Center staH in discussing a difficult reference question, particularly 
given the snail size of the Reference Center staff. The Reference Center 
staff may be able to reciprocate, making this situation mutually beneficial. 
This quid pro quo is desirable and to be encouraged, since it should be a 
mutually beneficial exchange. It means that the Reference Center staff and 
the host's reference staff can take advantage of the two-heads-are-better- 
than-one hypothesis (see Hypothesis section), and vice versa. If it is mu- 
tually beneficial, the host nay not need to be compensated for the time which 
host reference staff spend helping the Reference Centers. 



4.3 BftRC and SCAN 

BARC and SCAN predate the existence of most of the Systems and have been in 
operation for twenty years. BARC and SCAN are located in two of the largest 
public libraries in California -- the main libraries of the San Francisco 
Public Library (SFPL) and Los Angeles Public Library (LAFL). They therefore 
have an edge on most of the Reference Centers (with the exception of HCLS 
which is also located at LAPL) because of the nature of the resources at their 
disposal . 

The State Library has been using LSCA money to subsidize BARC's and SCAN's 
services since they first opened their doors. Last year their combined budget 
request to the State Library exceeded SI million. They only received $900,- 
000, because of the many issues relating to LSCA which are described in the 
discussion of the Policy Environment below. The State Library has held BARC 
and SCAN budgets constant since 1981. Consequently their budgets have de- 
clined in real terms. They have been forced to cut back on staff and on the 
level of reference-related services. 

BARC and SCAN are usually described in one breath as BARC/SCAN, but they are 
two quite different entities. Their reputations in the state vary in terms of 
the type of service being discussed. BARC was known for the caliber of its 
workshops in the past (they have since severely cut back training as a result 
of their declining resources), and SCAN for its one-day training sessions 
which introduced hundreds of libraries in the region to SCAN's services. 

Both BARC and SCAN are highly valued. In particular, they . both praised 
for the following services; 

(1) the caliber of their question handling and the documentation they 

provide to the Reference Centers on how they developed their refer- 
ence strategy (this documentation is viewed as a valuable teaching 
aid and a source of quality control); 

(2) the extensi veness of their "info-files" and the role these files of- 

ten play in providing the Reference Centers with quick answers; 

(3) their ability -- because of the combination of their own experience, 

past training, and physical location to tap resources (e.g-^ their 
hosts' collections, their own i nf o-f i 1 es , " outside collections via 
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telephone, and data base searching oi both the comisonl y*u5ed and 
specialized data bases); 

(4) their newsletters, which provide information used for question han- 

dling by the Reference Centers, and serve as a form of education and 
training; and 

(5) the caliber of the finding tools which they have published over the 

years, most of which have been discontinued as a result of budget 
cuts. 

Super Reference Centers budget their reference funds in a variety of ways to 
deliver reference-related services. In our survey, the Reference Centers were 
asked to develop a program budget, allocating the CLSA and local funds they 
receive to the four reference functions: question handling, education and 
training combined with quality control, and developing specialized resources. 

BARC and SCAN were asked to report their expenditures for FY 19BS by reference 
function in the following line items, which summarize the type of resources 
that th(? Centers have: total salaries and benefits for all staff (support, 
professional, and contract labor); other direct costs — telephone and data 
base searching; purchase of reference materials for the host and/or for the 
Center; supplies and equipment; and the indirect rate. 

Survey Table II shows that BARC spent 54*/. of its resources on question han- 
dling as compared to 66'/. for question handling at SCAN. Interestingly, their 
total average expenditures cone to 60'/., which is lower than the Reference Cen- 
ter average of 64'/.. BARC spent 15V. on education and training, as compared to 
SCAN at 4'/., and together they averaged 9.8'/., which is comparable to the Refer- 
ence Centers, which spent 9.4'/ on eiJucation and training overall. 

BARC and SCAN were fairly comparable in their allocation of funds for 
developing specialized resources with BARC spending 19'/. and SCAN at Ibl of 
total resources. Their average expenditure for developing specialized 
resources came to 16.4'/., or ten percent higher than the Reference Center 
average (9.7V. of total expenditures for developing specialized resources). 
Ten percent of BARC's expenditures fell into the "all other" category as 
compared to 14'/. for SCAN. 

BARC and SCAN both allocated funds for data base searching and for telephone 
costs (which were principally associated with question handling). BARC's ex- 
penditures for data base searching ($12,000) were much higher than SCAN's 
($6,000), probably as a function of having a smaller collection. Their tele- 
phone costs were almost identical at roughly $6,000. Neither purchased any 
reference materials for the host; but both added to their own reference col- 
lections — BARC spent $1000 and SCAN $3,000, In comparison, all Reference 
Centers purchased reference materials, either for the. host (about half the 
Centers) or for use in the Center office (about half the Centers). 

As BARC and SCAN have had to cut back on the level of service, in response to 
their frozen budgets, nore of the remaining resources were invested in ques- 
tion handling and quality control and less in educat i on/ tr ai ni ng and develop- 
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ing specialized resources. As a result, the amount oi staff tine and re- 
sources devoted to question handling has increased, waking the unit cost per 
question high. As Survey Table III shows, the average cost per question han- 
dled by BARC and SCAN Has $B0 in FY 19B5, as compared to $31 on average at the 
Reference Centers. These costs are a function of the composition of BARC and 
SCAN staff, location, as well as their service philosophy. 



BARC and SCAN Staff 

The staff are very experienced, averaging 19 years of reference experience, as 
compared to 11 years of experience among the Reference Center staff (see Sur- 
vey TahJe IV). Over 707. of their staff costs are for professionals and ap- 
proximately 307. for support staff (the same is also roughly true for the Ref- 
erence Center Staff(see Survey Table V). The ratio of professionals to 
support staff, however, does result in higher costs, since professional time 
has to be spent doing some of the tine consuming searching of the collection 
and telephone folloN-up which could be handled as efficiently and at a lower 
cost by trained parapr of essi onal s. 

All BARC and SCAN staff have worked for their hosts prior to joining BARC and 
SCAN, since their hosts require that these staff be drawn from the host staff. 
Because of the reputation of BARC and SCAN for doing high quality reference, 
they attract and hire senior level staff who are expensive because they are 
high up on their host's pay scales. BARC and SCAN staff averaged 13 years of 
prior experience at their host institution (as compared to six years of prior 
host experience among the Reference Center staff). 

Many participants in the study process voiced concern about the requirement 
that BARC and SCAN staff be drawn from the staff of their host library. They 
complained that no new blood can be introduced into BARC and SCAN and that 
consequently BARC and SCAN staff have become very set in their ways. They 
question whether only the most senior staff need to be at BARC and SCAN. They 
also perceived a lack of strong aanagement skills in both staffs, since good 
reference librarians do not necessarily make for good managers. The feeling 
was that had there been more able management, BARC and SCAN might well have 
been able to adapt to the changes which they have had to face: the growing 
sophistication of some oi the Reference Centers and their shrinking budgets. 

While the prevalence of senior staff makes BARC and SCAN expensive, there are 
trade-offs. BARC and SCAN staff know their host collection well. They also 
know one another's strengths, and work well as a team. Evelyn Breenwald, the 
Director of SCAN, characterises this relationship as being like a well estab- 
lished marriage. 

The value of the experience and expertise of the BARC and SCAN staff, combined 
with their knowledge of their very large host collections, is worth a lot, if 
one assumes that they are more efficient and able to provide a higher quality 
of reference service. A number of the hypotheses developed during the course 
of this study place a premium on these variables in the context of delivering 
reference. 
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Some participants would trade oH this experience in order to have the flexi- 
bility oi being able to hire staH Mith specific skills which are needed (such 
as management skills to run the service), and to drive down the labor costs 
down sonewhat. Dn the other hand, it should be understood that a strong ref** 
erence staH is always going to be an expensive commodity. 



BARC and SCAN^s Information Resources 

BARC and SCAN have created powerful files with thousands of entries (both ver- 
tical files and card files) which provide them with answers and related 
materials that they have saved from previous questions when they anticipate 
that the same question is likely to come up again.'' BARC staff estimate that 
they use their "info file" to answer 15X of the questions they receive. SCAN 
estimates they use their files to answer 107. of the question they receive. In 
neither case does the percentage suggest that the info files are the exclusive 
source for the question. In nany cases, the staff go to additional sources as 
wel 1 . 

While BARC and SCAN do not have an organized multi-type network like some of 
the Reference Centers, BARC and SCAN staff are masters at drawing on outside 
resources. Over the years, they have created very strong contacts with the 
special and academic libraries, and with other organizations and companies, in 
the metropolitan areas of San Francisco and Los Angeles. They have been able 
to gain access to sou? of these resources in a way that any given local public 
library could not, sifcply because BARC and SCAN offer their highly skilled 
help in return. Thvy also use outside resource sparingly. In turn, the ins- 
titutions providin' ^ecialized resources appreciate the screening that BARC 
and SCAN provide. t .icy believe that it keeps them from being flooded by indi- 
vidual requests frcm public libraries. 



4.4 Reference Functions Currently Performed by BARC and SCAN 

Over the years, the public library community has come to rely on BARC and SCAN 
to set the tone for quality reference and to provide visibility and "leader- 
ship" for performing the reference function at the local and system level. As 
mentioned above, question handling is only one of four reference functions 
which BARC, SCAN, and the Reference Centers all provide. The other three 
functions are: education and training, developing specialized resources, and 
providing quality control, which is implicit in the other three functions (see 
Definitions above). The Reference Centers provide parallel services to their 
local public libraries (as was discussed above). The aajor functions per- 
formed by BARC and SCAN are summarized briefly below. 



^While these files are very extensive, they are also dated and could not 
be easi ly automated. 
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They answer reference questions from the public, referred by the 17 
SystBRi Reference Centers, by using the LA and SF public library re- 
sources (collections and staff), as well as specialized resources 
available to BARC and SCAN reference staff (e.g., specialised data 
bases, BARC and SCAN-devel oped "info-files," contacts in the library 
community (e.g., academic and special libraries) as well as in the 
broader population (e.g., companies, organizations, individual ex- 
perts) ; 

They train and educate the reference staff at the system level as 
well as the local level both formally and informally (e.g., by de- 
veloping workshops in reference skills, in special subjects, by 
writing articles in the BARC and SCAN newsletters, by acting as 
consultants in person or by telephone, as well as teaching by doing 
which involves providing an audit trail of the strategy used to 
answer each question so that others down the line can learn from 
their approach); 

They provide implicit quality control. Since there are no formal 
standards for measuring quality or even a definition of quality, 
BARC and SCAN are perceived as setting the highest professional 
standard for answering questions which provides a bench mark for the 
local public library and the system reference centers. Highlighted 
in the King study is the observation that BARC/SCAN staff provide 
role models for reference staff at the first and second levels which 
King suggests has resulted in improved reference performance at the 
lower levels. 

They develop specialized resources that make answering questions 
more efficient, (e.g., buying specialized materials, creating find- 
ing tools such as union lists, bibliographies, "info files.'' and 
lists of facts such as those provided in Scanni ngs ) . 



BARC and SCAN Host Collections; Los Anoeles and San Fra ncisco Public Libraries 

By being located in the same building as the main libraries of SFPL and LAPL, 
BARC and SCAN staff have convenient access to the reference resources in the 
main library and can provide statewide access to two of the strongest collec- 
tions in the state. They can also draw on the collections of the entire pub- 
lic library system, which includes the branches. SFPL's collections, system- 
wide, total nearly 2 million volumes and LAPL's total over 5 million volumes. 
Heretofore, however, no data were available on those resources located in the 
two main libraries. The host survey conducted during this studv filled this 
gap and provided the following estimated data for the main libraries for both 
LAPL and SFPL (see Survey Table VIII). 

Los Angeles Public Library (LAPL) estimates that its central collection con- 
tains 2,000,000 volumes in the general and reference collections (both of 
which grew at about in FY 1985), 19,000 periodical titles, and 1.3 million 
government documents. The main library at LAPL has 79 FTE reference staf^, 
all of whom have a Masters degree in Library Science and 12 of whotr. have an 
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additional advanced degree. The fact that the main library at LAPL was 
recently badly datoaged by a fire (April 19B6) represents a short-terra set 
back, but LAPL will recover its full strength over the next feH years. 

The fire, however, has forced SCAN to move to temporary quarters at the Uni- 
versity of California at Los Angeles (UCLA), which has disrupted SCAN's ser- 
vices. BARC has been helping out by handling sorae of the questions which 
would ordinarily be handled by SCAN. This disruption in service has been con-* 
sidered in the development of the timetable for the transition plan (see the 
introduction to the discussion of the transition plan). The fire has also 
forced the KCLS, which is also hosted by LAPL, to stove to UCLA as well. 

San Francisco Public Library (5FPL) estiaates that its central collection con-* 
tains 1.1 million volumes in the general and reference collections (which grew 
at a rate of 2.97. for the general collection and at a rate of 3.47. for the 
reference collection in FY 19B5), 10,000 periodical titles, and 3.5 Aillion 
government documents. The main library at 5FPL has 64 FTE reference librar- 
ians, all of whom have a Masters degree in Library Science; none have an addi-* 
tional advanced degree. 



5. POLICY ENVIRONMENT 

There have been a number of studies of reference referral in California. To 
understand why the current study was undertaken, and why the group process 
methodology was chosen, it is important to understand some of the policy con-* 
straints facing the State Library and the environment in which policy discus- 
sions have occurred to date. 



5. 1 Resource Constraints 

The State Library initiated the current 
make major changes in funding structure 
ral services. 



study largely because of the need to 
for the provision of reference refer- 



0 The State Library has been supporting BARC and SCAN for nearly twenty 
years using soft (i.e., unpredictable) money from Titles I and III 
of the Library Services and Construction Act (LSCA); 

0 The grants to the San Francisco Public Library (5FPL) for BARC and to 
the Los Angeles Public Library (LAPL) for SCAN ($900,000 combined 
for FY 1986), constitute a significant fraction of California's to- 
tal LSCA funds. 

0 Despite the fact that BARC and SCAN have cut back on staff and ser- 
vices, it was anticipated that together they would still request 
over one million dollars in FY 1987, in order to cover the salary 
increases that SFPL and LAPL staff will receive. 
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0 LSCA requires that the LSCA funds be used ior demonstration grants 

(short term) ior library cooperation, not ior ongoing support (long 
term). For years, CSL has deviated from the intent of the Act by 
providing ongoing funding to BARC and SCAN. 

0 The uncertainty of LSCA funding as a result of the threat of unspeci- 
fied budget cuts by federal agencies responding to the requirements 
of the Gramm-Rudman Act. It was not certain to what extent LSCA 
would be cut overall. This year the State Library has already lost 
$620,000 or 4.3'/. of the FY 19B5-6 LSCA appropriation. 

To add to this climate of uncertainty and scarce resources, public libraries 
in the state are still reeling from the effect of Proposition 13. Indeed, the 
Public Library Fund (PLF), which provides unrestricted state funds to local 
public libraries, is being used to offset the effects of Proposition 13. It 
seems unlikely that significant local contributions will be made to fund 
reference referral in the short term, although some local funds may be 
earmarked to support reference referral over time. 

Therefore, an operating assumption for the study has been that funds for 
reference referral would be limited to those presently available under CLSA 
for reference services (as discussed above). In FY 1985, there were $1.5 
million for reference service delivered through the Systems. While seeking 
funding to support reference referral seems an appropriate and necessary 
activity the strategy for doing so is not within the scope of this study. 

Furthermore, it has been assumed that the proposed models for a new reference 
referral structure will fit within the currently unfunded Article 6 of the 
California Library Services Act (CLSA), Section 1B760, "State Reference 
Centers," in the short term. In the longer term, as the reference referral 
system dovetails with the emerging multi-type library network, it is likely 
that CLSA will be revised to accommodate both the requirements of a multi-type 
network and of the reference referral component. Section 1B760 of CLSA now 
reads: 

"The state board shall establish and administer two or more state 
reference centers. The centers shall be responsible for answering 
reference requests that cannot be met by systems and libraries 
participating in the programs authorized by this chapter."^ 



•Unfortunately, a number of public libraries will not qualify for PLF 
funds in FY 1987 because their local budgets have fallen below the previous 
year's budget. PLF requires maintenance of the previous year's budget level, 
in order to trigger funding; a number of public libraries appear to be losing 
ground . 



^California Library Services Act in California Library Laws. 1961 , 
published by the California State Library (1961). 
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Given these funding uncertainties, and given the -fact that LSCA lioney is in- 
tended to be used for derrionstr at i on grants, not for ongoing programs, the 
Stdte Librarian asked a member oi his staff to prepare a report on the issues 
"relating to the use of LSCh funds in support of third level reference refer- 
ral*' (i.e., 6ARC and SCAN) and {nake recommendations about Hhat should be done 
Nith these organizations. This was the third in a series of studies on higher 
level reference in the state. 



5.2 Past Studies 



Peat, Harwick and Kino Studies 

In the past ten years, the State Library haii commissioned two major outside 
studies of reference referral: a study by Peat, Marwxck, Mitchell It Co. in 
1975; and a study by King Research, Inc. in 1981. These reports provided val- 
uable insights and useful recommendations to the State Librarian, but there 
has been a lack of support for the findings by neoibers of the public library 
community in California. Complaint* focused on the view that neither firm had 
fully grasped the nature of the probem and that the library community had not 
been consulted sufficiently during it ^rse of the studies. 



Staff Report on Third Level Reference 

The third study was done internally by the State Library and was published in 
19B5. As with the earlier studies, there was an absence of consultation with 
the library community. The report, titled "A Staff Report on Third Level Ref- 
erence," examined the question of the cist of reference referral using BARC 
and SCAN, and made the following recommendations: the two institutions should 
be phased out after FY 19B5-B6 and BARC and SCAN staffs absorbed back into 
the staffs of the San Francisco and Los Angeles Public Libraries. 

Since BARC and SCAN were perceived by many practitioners to be a major com- 
ponent of reference referral in the state, it was no surprise that the public 
library community was upset to learn that the State Library was questioning 
the cost effectiveness of BARC and SCAN and recommending that both be disman- 
tled after September 30, 19B6. In the report, no alternative to BARC antl ^^CAN 
was put forward to fill the vacuum. The lack of warning about the outcoine of 
the report, combined with the lack of consultation with the field, caused an 
uproar. Furthermore, since the State Library's staff report did not provide 
alternatives to delivering BARC and SCAN services, the public library commun- 
ity was faced with the prospect of being left empty-handed, without a fall 
back. 

In a cover memorandum that accompanied the report, Bary E. Strong, State Li- 
brarian, requested that the report's findings and conclusions be "...a start- 
ing point for a process that will allow for thoughtful consideration and the 
broadest possible input before any final decisions are made." He went on to 
say : 
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"It 15 apparent that the process fiay result in a redefi- 
nition of the roles oi the Los Angeles and San Francisco 
Public Libraries in relation to system level reference 
centers. I also expect other alternatives to established 
patterns of reference referral to emerge. 

The State Library received over a hundred letters praising BARC and SCAN ^or 
their leadership in providing reference referral of the highest level. Many 
librarians attended the two state-sponsored regional hearings (described be- 
Ion) and there were over 175 respondents to a State Library-developed ques- 
tionnaire Nhich asked for feedback on BARC and SCAN services. 



Regional Hearings in Response to the State's Study 

Tmo factors are apparent based on a reading of the transcripts from the two 
regional meetings. First, the State Librarian was trying to deal responsibly 
with the potential loss of LSCA funding by asking the library community to 
work with him to examine options. Second, many members of the public library 
community were operating without a complete awareness of the financial and 
pol i ti cal cl imat e. 

Given the intensity of the response to the State Library study, the State 
Librarian decided to hire an outside consultant to undertake another study. 
This study was intended to focus on the role of "third level" reference in 
California. Given the importance of the public policy issues involved, it is 
useful to understand how the scope o^ this study evolved from the original 
proposal to include an examination of all reference referral in the state. 



5.3 DriQinal Mission of the Study 

In its January 19B6 solicitation, the California State Library asked: what is 
the most cost effective and efficient way to «ake available the services now 
provided by BARC and SCAN? Implicit in the question was the issue of whether 
the cost of supporting BARC and SCAN was justified. The task at hand appeared 
to require identifying what services BARC and SCAN provided; determining the 
costs, if possible; comparing them to alternatives; and recommending the 
changes that would have to be made to improve cost effectiveness and efficien- 
cy in delivering the services. 

It seemed a reasonable question. The State Library had supported BARC and SCAN 
for twenty years using LSCA funds. LSCA was in danger of being cut back at 
the federal level, making it all the more important to evaluate the costs and 
benefits of BARC and SCAN, since the continuation of their services would 
probably require state and/or local funding. And if BARC and SCAN services 
were so important, it seemed appropriate to spend hard money to support the 
services (i.e., state and local funds), rather than to depend on soft money 
(federal) . 
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Furthermore, the staf^ at the State Library needed an answer to the question 
by July 19B6, in order to determine Hhat level of LSCA--f undi ng , ii any, BARC 
and SCAN should receive in FY 19B7. The LSCA Committee Mas scheduled to meet 
during that summer to decide on which LSCA projects to 'fund. Consequently, 
there were only five months in which to arrive at conclusions and recommenda- 
tions. This seemed a short, but manageable amount oi tine in which to arrive 
at Norkable conclusions. 

The Select Comiriittee on Third Level Reference and the study consultant set to 
work defining reference functions performed by BARC and SCAN. Four functions 
were identified: question handling, education and training, developing spe- 
cialized resources^ and quality control. Levels of question handling were 
also identified. It was assumed that BARC and SCAN were handling "super 
reference" questions and therefore the Committee changed its name to the 
Committee on Super Reference. 

As the study progressed, it quickly became apparent to the consultant and the 
Select Committee that the problem being addressed was both much broader and 
more complex than simply advising on the costs and benefits of the services of 
BARC and SCAN. It also became clear that the discussion had to be based on a 
clearer statement of the funding constraints: 

If there are no LSCA funds and no new CLSA funds for the provision 
of two or «ore statewide reference centers, would public libraries 
in California agree to reallocate existing state and local aoney to 
support reference referral functions, such as those services which 
have been perforaed by BARC and SCAN and have been subsidized by 
LSCA? If so, which functions and services would public librarians 
support by reallocating existing state and local funds? 



5.4 The Concept of Statewide Access 

Underlying the original cost/benefit question lay the unstated quesi^on of 
whether there should be statewide access to reference resources at all. Would 
the resource rich enable the resource poor in the state to have mediated ac- 
cess (i.e., through the reference referral process) to their reference re- 
sources by dedicating state and possibly local funds? 

"Statewide access" is an elliptical term, developed during the course of the 
study by the participants. It involves the delivery of an agreed-upon level 
of reference service to California library users in order to make reference 
service "equitable" throughout the State, regardless of geographic location, 
wealth of local jurisdiction, or size of local library resources. Statewide 
access thus involves providing access to library and information resources 
regardless of where they are located in the state. 

It became apparent that the first order of business in the study was to obtain 
a sense of the willingness of the public libraries in California to spend 
state and lt)cal funds to support the sharing of reference resources. If 
statewide access to reference resources in the state is important, it would 
require reallocation of state funds to achieve. Indeed, it night well require 
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the contribution oi local funds as well. Given concerns about funding, thE- 
relevant policy questions for the stakeholders are; 



(1) Does the public library coaiunity want to insure that patrons 
across the state have access to a specified quality of rtference 
service, regardless of variations in local reference resources? 

<2> If fto, to Mhat degree and hoM Mould the service be funded? 

The State Librarian and the Select Committee agreed that the concept of state- 
wide access was central to the study. They also agreed the answer to these 
questions should come from the stakeholders themselves. The study process 
thus had to involve stakeholders in r discussion of this issue in an effort to 
gain consensus. 

Stakeholders include the BARC and SCAN staff; staff at both the Reference Cen- 
ters and the Systems; staff at the various "hosts'* <i.e., those libraries in 
which the System Reference Centers and BARC and SCAN were based); as well as a 
representative cross section of reference librarians at local public librar- 
ies, who depended on reference referral to back-up their local reference 
resources. 

Secondly, BARC and SCAN services could not be evaluated in a vacuum. They 
were part of a public library reference referral system. It would be impos- 
sible to determine how to make BARC and SCAN services more cost effective and 
efficient without understanding how BARC and SCAN fit into the system. Any 
assessment of the costs and benefits of BARC and SCAN services would have to 
involve a comparison with those services provided by the Reference Centers. 
Since the Reference Centers' services to their public library fliembers inter- 
sected with those provided by BARC and ^fAN, it would necessary to examine the 
reference-related functi;**^^ they each pfa*\de6. 

Furthermore, since the Reference Cent ' Ucended on BARC and SCAN in order to 
deliver services, it would be importa.. 'leteroine what the impact of elimi- 
nating or reducing BARC and SCAN services would be on the performance of the 
Reference Centers. It would therefore be necessary to analyze the flow of 
services from BARC and SCAN to the their primary customer base, the System 
Reference Centers of the Cooperative Library Systems. 

As a result of these considerations, the State Library and the Select 
Committee agreed that the study should examine the Systeoi Reference Centers 
and their relationship with BARC and SCAN — a considerable expansion of the 
original scope of the study. 



5.5 Restatement of the Mission of the Study 

The scope of the study now involved an examination of the entire reference re- 
ferral process in California ---a major public policy issue. The mission of 
the study was therefore restated as follows: 
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To deteriine nhether and to Mhat extent public libraries in Califor- 
nia Mould be Milling to reallocate state and local 'funds to support 
re'ference referral functions, such as those services that have beet, 
perforsed by BARC and SCAN (nith LSCA subsidy) in the past. 

The assumption was that there would be no additional state or local ffione-y in 
the short teriD to underwrite any BARC and SCAN reference functions that stake- 
holders wanted continued. 

To occomplish this new mission, it would be necessary to: 

(1) define the nature of reference-related services provided by BARC, CCAN and 

the System Reference Centers; 

(2) describe the major differences in reference services between BfiPC sncJ iCAN 

and those of the System Reference Centers (e.g., unit cost, level of ser- 
vice); 

(3) determine whether public libraries were willing to allocate scarce re- 

sources to provide statewide access; and 

(4) involve key stakeholders in the discussions and in the development of 

recommendat i ons. 

All of these activities had to be accomplished within the original five month 
time frame of the study. 



6. 6RDUP PROCESS 

To accomplish the expanded mission of the study, a highly participatory group 
process was developed. Furthermore, it was very important to the success of 
the process for the consultant to work closely with the Select Committee, ap- 
pointed by the State Librarian, and to meet with the key players. Over 70 
people attended each of the focus group meetings atvj one of the two regional 
follow-up meetings, at their own expense. 

The purpose of the focus groi^ps and regional meetings was to inform partici- 
pants ac the same time that it actively involved them in making choices. The 
participants were asked to identify alternatives to the existing r^rference 
referral structure, to make decisions about how best to reallocate existing 
state funds in the absence of continuing LSCA subsidy of BARC and SCAN, and to 
consider a number of possible new organisational structures for delivering 
reference referral . 

The consultant's role was to lead the process, synthesize the information ge- 
nerated through the process, summarize recornmendations, and prepare a final 
report. The consultant served as facilitator during the entire study process, 
as well as the distiller of information about reference and reference refer- 
ral. The conceptual framework and the vocabulary, which set the terms of the 
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deliberative process, were developed by the consultant and refined by those 
involved in the study process. 

Since there were only five months in which to conduct and report on this 
study, it was essential to develop a highly structured process which would 
ensure a tangible outcome. The focus group format evolved during the course 
of the study, as described below, and was monitored in monthly meetings with 
members of the Select Committee. 



6. 1 Focus Group heetinos 

The consultant held seven focus group meetings throughout the state in order 
to minimize participants' travel time and costs. Focus groups met during 
March and April 1986 at public libraries in Carlsbad, Oakland, San Francisco, 
Orange County, Santa Honica, Saratoga, and the Rar^ona Building, California 
State Library in Sacrairiento. Two /iitembers of the Select Committee attended 
each focus group. The size of the focus groups was kept to a maximum of 16 
participants, in order to insure that there was an opportunity for all meibers 
of the group to be active participants in the group process (see Table 4 anJ 
Table 5). 

The focus group meetings provided a way to: (1) present the objectives of the 
study; and (2) present and reach agreement on a conceptual framework for ad- 
dressing a public policy problem; (3) equip key stakeholders with an agreed- 
upon vocabulary for discussing reference referral in the state; and (4) iden- 
tify data needed to make decisions. Participants received a working paper, 
prepared by the consultant, in advance of each focus group. The working paper 
described the objectives and context cf the study, and provided participants 
with a conceptual framework, a new vocabulary, and some working hypotheses to 
use in focus-group discussiont 

A schematic drawing, showing the flow of questions through the hierarchy, pro- 
vided a way to clarify how the exis^ting structure functioned.^*' Both the 
schematic and the working paper were revised after each focus group meeting. 
In that way each subsequent focus group benefited from the comments made by 
preceding groups. 



6. 2 Region al heet i nqs 

There were two regional meetings in Hay 1986 at Cerritos and Oakland Public 
Libraries. Participants were asked to advise on how best to provide back-up 
reference assistance to public libraries in the state, given the current level 
of state (CLSA) funding, and assuming that L5CA subsidy support of BARC and 
SCAN would no longer be available in the near term (gray sky scenario, limited 
to spending $1,5 million of CLSA funding), as well as given a more optimistic 
blue sky funding (no specified funding constraints). 



^^This schemdtic diagram was discussed earlier. 
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TABLE A 



Regional Meeting - Cerritos 
May 28, 1986 

RANKING OF FUrJCTIONS BY MODEL: Grey Sky Scenario 



FUNCTION 


PYRAMID 


REGIONAL 


►SUPERMARKET 


Question 
Answering 1^ 


80% 


/3% ASP 10% Super 
85% 


70% 


Education & 
Training 2 


20% 


10% 




Special 
Resources 2 


0% 


5% 


20% 

15% 


Education & 
Training i 


0% 


0% 


5% 

10% 


Quality 
Control £ 


0% 


0% 


5% 



Each group (Pyramid, Regional, and Supermarket) reached agreement 
on an estimated percentage of resources to be directed to each of 
the four functions. This ranking is reflected above. Note that 
"Education and Training" was selected #2 by the Pyramid and Regional 
groups and #3 by the Supermarket group. 
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TABLE 5 

Regional Meeting - Oakland 
May 30, 19 86 

RANKING OF FUNCTIONS BY MODEL: Grey Sky Scenario 



FUNCTION 


PYRAMID 


REGIONAL 


SUPERMARKET 


Question 
Handling 1 


70% 


75% 


60% 


Education 
Training 2 


20% 








Special 
Resources ^ 





15% 





Quality 
Control 2 







20% 


Education 
Training 2 


10% 


8% 


10% 


Special 
Resources £ 






10% 


Quality 
Control 4 


-0- 


2% 




TOTAL 


100% 


100% 


100% 



Each group (Pyramid/ Regional ^ and Supermarket) reached agreement on 
an estimated percentage of resources to be directed to the functions 
in their models This ranking is reflected above/ with each function 
appearing in the rank order given by each group. 
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At these two regional tneetings, participants broke into three smaller groups. 
Each group was assigned one of the following three possible models for deliv- 
ering reference referral in California: e pyramid model (hierarchical), a re- 
gional Bodel, and a supermarket nodel. Each group was ac^ed to discuss the 
merits of the nodel they had been assigned and to use their assigned model as 
a jumping off point for developing a workable orgvini zat ir^iiol structure. They 
were asked to rank reference functions in order of funding priority, given the 
two different scenarios: blue sky and gray sky. 

Because all participants had attended the focus Qroup mE^^^^ings, there was a 
common understanding of the task they had besn assigned. They were able to 
draw on the conceptual framework and working hypotheses which they had refined 
in the focus group meetings. The fact that they shared a common vocabulary 
and a common set of definitions made it possible to speed the discussion and 
to reduce mi scommuni cat i on . For obvious reasons, no newcomers were allowed to 
participate in the follow-up meetings. 

While the final decision about organization structure and reallocation of 
funds rests with the CLSB and the State Librarian, respectively, the stake- 
holders reali;^?d that their views were being actively sought. The level of 
participation was extraordinary. By and large the tone was measured and the 
effort deliberative. There seemed to be a great willingness to come to grips 
with some important philosophical issues relating to such questions as whether 
there should be statewide access to reference resources, quality vs. quantity, 
and local control versus delegating r esponsi i. 1 1 i ty. The participants also were 
willing to work within the structure of the process. 



6.3 Parti ci pants 

Hany people participated in the study in a variety of ways. Some advised, 
some critiqued materials, some expressed concerns, some provided background 
information. There were Bevc?ral ways that individuals participated in the 
study process: by serving on the Select Committee on Super Reference, or the 
Ad Hoc Reference Committee; by participating in one of seven focus groups and 
one of two regional meetings; by serving as additional resource people to the 
consultant; and by responding to the request for data needed to fill 
information gaps. A description of the activities of each group is described 
bel ow. 



The Select ComiT;itte& on Super Reference 

The State Librarian appointed an advisory committee of five to work with the 
study consultant. Originally, the committee was called the Select Committee 
on Third Level Reference. When a dew vocabulary was introduced during the 
study process, the Committee's name was changed to the Select Committee on 
Super Reference (to emphasize the content of reference referral rather than 
the physical structure). The Select Committee was composed of five highly re- 
spected librarians, each of whom served as head of their library, or library 
system: Clifford Lange, Director, Carlsbad City Library; Holly Millard, Di- 
rector, The Metropolitan Cooperative Library System; Ursula Meyer, Director, 
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Stockton-San Joaquin County Public Library; Nan Vaaler, Director, Napa City- 
County Library; and Linda Wood, Director, Riverside City and County Public 
Library. 

The Select Committee worked extremely hard and invested a tremendous amount oi 
their time in educating the consultant about the background and nature of the 
issues. They reviewed all written materials and critiqued the study process 
and findings. In addition to meeting four times in Sacramento with the 
consultant (Gary Strong, the State Librarian, attended two of these meetings), 
they each attended at least one of the seven focus groups and one of the two 
regional meetings in Hay. They engaged in several lengthy conference calls 
with the consultant, and they communicated with the consultant frequently by 
telephone and through Ontyroe, the electronic mail system. As a consequence of 
this intensive dialogue, the recommendations and the transition plan that 
appear in the beginning of this report have been submitted by the study con- 
sultant in conjunction with the Select Committee. 

Ad Hoc Reference Committee 

Because the Select Committee was composed of administrators, not reference ex- 
perts, an Ad Hoc Reference Committee was appointed by the State Librarian to 
assist the study. Each of the three individuals who participated in the Ad 
Hoc Committee is highly respected by reference librarians working in public 
libraries in the state. Each has worked in either a System or a System Refer- 
ence Center, or both at one time. All are now in other jobs. Therefore, they 
were able to look back dispassionately at their experiences with BARC and SCAN 
and with the System Reference Centers. The members of the Ad Hoc Reference 
Committee are: 

Pat Flowers, Head of Reference Services, Revera Library, University of 
California, Riverside 'formerly, Reference Coordinator, Inland Library 
System) ; 

Debra Miller, Assistant County Librarian, San Diego County Library (for- 
merly, System Director, Serra Library System and Reference Coordinator, 
South Bay Library System) ; and 

Virginia Short, Head of Humanities/Social Science Department, University 
Library, University of California, Davis (formerly, System Director 
Mountain Valley Library System as well as Reference Coordinator pre- 
viously) . 

The Ad Hoc Reference Committee convened in San Diego to discuss whether (and 
if so, what) data should be collected that would give insights: (1) into the 
resources and capabilities of hosts, potential hosts, System Reference Cen- 
ters, and BARC and SCAN; and (2) the nature and level of questions being han- 
dled by BARC and SCAN. It was decided that the study would benefit from data 
on (I), but that (2) was too difficult to evaluate retrospectively. The Ad Hoc 
Committee did briefly review the back-up documentation provided by BARC and 
SCAN on the 4,000 questions they answered in FY 19B5. A summary of the find- 
ings appears is the Data Collection Section below. 
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Focus Grou ?3 i pant 5 

Participants, who Here invited by the staH at the California State Library, 
were selected because they were key stakeholders and because they were 
knowledgeable about reference referral in the state of California. They fell 
into the following categories, as identified by the Select Committee at its 
first meeting in Claremont; 

0 All Members of the CLSB. 

0 The directors of the host libraries to BARC and SCAN: John Frant:, 
Director, San Francisco Public Library and Wyman Jones, Director, 
Los Angeles Public Library. 

0 The directors of BARC and SCAN: Faun Hclnnis and Evelyn Gr;^enwald. 

0 The Reference Coordinators of the 17 System Reference Centers. 

0 Two Members from each of the 15 System Administrative Councils. 

0 Representatives of the California Congress of Public Library Systems 
(a group composed not only of som» of the System Reference Centers, 
but also of reference librarians working in public libraries in the 
state) . 

0 Representatives from the library of the California State Library. 

0 Representatives from the University of California, Berkeley and Los 
Angeles campuses. 

0 The members of both the Select Committee ? d the Ad Hoc Reference Com- 
mittee. 

0 Selected public library reference staff. 

A remarkably large number of people were able to attend both meetings, despite 
severe time constraints. Sixty-seven people attended both a focus group and a 
regional meeting. An additional 20 people attended one of the seven focus 
groups. Table b provides a tally of the number of participants at each of the 
focus groups and the two regional meetings. 

Some of the individuals who participated in the study process are listed be- 
low. A complete list of attendees appears in an appendi.x in Volume II of the 
report. 
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TABLE 6: FOCUS GROUP AND REGIONAL HEETING LOCATIONS, DATE, AND NUMBER DF 
ATTENDEES 



Locat i on 



Date 



Number o{ Attendees 



ERIC 



Focus Groups: 

Carlsbad March 27 

Oakland April 9 

San Francisco April 11 

Orange Co. April 15 

Santa Monica April 16 

Saratoga April 22 

Sacramento April 23 



12 
10 
B 
14 
12 
9 
14 



Total 



79 



Regional Meetings: 

Cerritos May 2B 

Oakland May 30 



30 
37 



Total 



67 



Reference Center staff: 



Sixteen of the 17 Bysteai Reference Center Coordinators attended the focus 
groups, and two System Directors attended by special invitation <they were in 
vited because they had made particularly thoughtful comments about how to 
change the organization structure of reference referral? Mark Park, Director, 
Hountain Valley Library System, and Pat Tarin, Director, Santiago Library Sys 
tern). It is also notable that each of the IS Systems Administrative Councils 
sent their full allotffient of two members of their Council to the focus group 
meetings. , 



CLSB Hembers: 

John Armstrong; Christa Buswell, Library Service, Wadsworth Medical Center, 
U.S. Veterans Administration; Lois Clark, Medical Librarian, Long Beach Com" 
munity Hospital; Nancy King, California State University, Los Angeles in the 
Department of Communications Studies; Janice Koyama, Head, Moffitt Undergrad 
uate Library, University of California, Berkeley; and Hal Watson, Director, 
Pomona Public Library. Ms. King and Ms. Koyama also contributed an academic 
perspective, and Hs. Buswell and Ms. Clark a special library perspective be-- 
cause of their employment. 



Library Staff of the California State Library: 

Sheila Thornton, Chief, State Library Services Bureau, and Charlotte Harriss, 
Head, Public Services. 



University of California Libraries, Berkeley and Los Angeles: 

Rita Kane, Associate University Librarian, the University of California, 
Berkeley (UCB) and Gail Yokote, Associate Biomedical Librarian for Public 
Services, UCLA Biomedical Library. Joyce Koyama, while a member of the CLBB, 
also was able to bring her perspective as Head, Hoffitt Undergraduate Library 
UCB. 



Additional Resource People 

A number of additional resource people assisted in this study. These individ 
uals contributed their time to discussing the study. They were: 

0 Nancy Van House, Assistant Professor at the University of Califor- 
nia, Berkeley, who was the principal author of the 1961 King study 
on California Statewide Reference Ref err al Service . 

0 Twenty graduate students at the Graduate School uf Library and 
Information Science, University of California, Berkeley (6LIS), 
enrolled in Professor Van House's graduate course on public library 
management, spring 1966. 
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0 Reva Basch, the Director O'F Research at Iri'Fornation on Demand (lOD). 
lOD has been involved in at least tNo relevant studies, relating to 
reference delivery; the recent San Joaquin/BARC/IOD study and the 
19B3 experiroent at the North Suburban (Illinois) Library System, 
which Mas reported in Li br ary Journal . 

0 Charles Bunge, Processor, School Library and Information Studies, 
University oi Wisconsin-Madison, who is an expert on reference eval- 
uation . 

o Numerous librarians who took the time to write or call either the 
consultant or the members oi the Select Committee. 

Professor Van House provided comments on the methodology, on the working pa- 
per, and on the data collection instruments. She also provided the opportuni- 
ty to meet with her class twice to pretest materials developed for the neetinci 
with the Select Committee on the decision tree/critical path analysis and for 
the focus group meetings. 

Several members of the class (Susan Elliott, Daniel Hersh, and Bill Trzeciak) 
coded data collected during the study in the two questionnaires, and Susan El- 
liott entered the data into computerized spreadsheets. Bill Trzeciak conduc- 
ted a literature search to determine whether any research had been conducted 
on the sequence in which reference resources are used in question answering. 

Reva Basch of IDD attended one of the sessions of Professor Van House's class 
in which the study process was being pretested. She was prepared to be of 
assistance had the Ad Hoc Reference Committee wanted help in evaluating the 
questions received by BARC and SCAN. 

Professor Bunge, like Ms. Basch, stood ready to assist in evaluating BARC and 
SCAN questions, and suggested other experts in reference evaluation who Bight 
be useful if more help was needed. 

A significant number of people took the time to discuss the study with the 
consultant in person, over the telephone, or by letter. In particular: 

Wyman Jones, Director of the Los Angeles Public Library invested a 
tremendous amount of time brainstorming about the study with the 
consultant, and introducing the consultant to the resources housed at 
main library — prior to the fire. 

Pat Tarin, the Director of the Santiago Library Syste/r., engaged in 
several lengthy phone calls with the consultant throughout the study. 

Susan Holmer, Bwen Cain, and Eleanor Schmidt, Reference Coordinators at 
Peninsula, Black Bold, and Metropolitan Cooperative Library Systems. 

Lee White, Director of the Oakland Public Library. 
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A number oi host library and System Reference Center staff were willing to 
play the role of recorder in the focus group and regional meetings. They 
were: Linda Banner, Rae Beverage, Linda Carroll, Renee Koont?, Leslie Nordby, 
Ann Sklensky, Jo Trotter, Donever Waters, and Rosemary Woodrow. Jim Henson, 
State Library Consultant assigned by the State Library to staff the project, 
served as a recorder five times over the nine meetings. He also provided 
liaison with the State Library, handled local arrangements and mailings, and 
identified the availability of data collected by the State Library. 



7. ANALYTIC FRAMEWORK 



7. 1 Decision Tree and Critical Path Analysis 

A technique involving the use of a decision tree and associated "critical 
path" analysis of decisions proved useful at the first meeting with members of 
the Select Committee and the State Librarian in Claremont. A decision tree is 
a streamlined flow chart that graphically portrays sequences of choices that 
lead to one or more decisions, depending on which branch or branches of the 
tree are taken. It highlights the variables that are involved and provides a 
tool for discussing the effect of trade-offs in making choices. The decision 
tree approach is also a useful tool for focusing the attention of decision 
makers on identifying data gaps. Variables can be added or deleted from the 
decision tree as a result of discussion by decision makers. 

By using the decision tree, it became possible for the Select Committee to an- 
alyze the consequences of Riaking choices. Assessing why a path was selected 
down the decision tree is called critical path analysis. The outcome of a 
critical path analysis is intended to produce decisions based on a clearer un- 
derstanding of the issues and on an appreciation of the trade-offs. Using 
this tool, the members of the Select Committee identified additional informa- 
tion the key players would need in order to make informed choices. 

Figure 3 shows the path that both BARC and SCAN took after their funding was 
frozen in 1981. Committee members and the State Librarian were able to see 
the shift in BARC's and SCAN's reference priorities. It became clear that 
both BARC and SCAN had maintained the level of their question-handling func- 
tion at the expense of reducing the level of the other two reference-related 
functions: education and training, and developing specialized resources. 
Their response made it even harder to justify the use of LSCA funds, since it 
appeared that $900,000 were being spent to handle 4,000 questions. 

The decision tree/critical path analysis approach helped the members of the 
Select Committee to agree on the following issues: 

(1) statewide access to mediated reference assistance was a top priority 
in order to make it possible for a patron to get equitable help in get- 
ting a reference question answered, regardless of geographic location, or 
local or regional resource sufficiency; 
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FIGURE 3 



CHOICES FOP. 



IN 



(2) "Reference" as&istance, as delivered by BARC and SCAN was not sinply 
question handling,, but rather was a cluster of functions, including ques- 
tion handling, education and training, developing specialized resources, 
and quality control; 

(3) question handling Has a very high priority, but so Has education and 
training by BARC and SCAN because it would improve the quality of ques- 
tion handling at the System Reference Centers and, therefore, at the lo* 
cal public libraries, over the long tern; 

(4) developing specialized resources was important function that Has 
often a by-product of the question-handling function; 

(5) the need for quality control Has ifoplicit in the other three func- 
tions, but probably did not need to be nade explicit by developing foraial 
standards ; and 

(6) levels of question handling needed to be defined and the nature of 
resources that went with each level described for illustrative purposes. 

At the end of the meeting, the members of the Select Committee agreed on the 
categories of participants and desired number in each category (which are de- 
scribed above). 



7.2 Models of Drqanization Structure 

The minutes from the two regional Ductings appear in Volume II of the report, 
the discussion here highlights the key points stressed during the regional 
meetings held in Cerritos on May 2G and in Oakland on Hay 30). Participants 
were presented with three pos^iible nodels in two scenarios: blue sky (no 
funding constraints) and gray sky (linited to spending the existing $1.5 
million of CLSA funds, which is currently allocated for reference-related 
servi ces) . 

The three models were: (1) the pyramid model (hierarchical, with super refer- 
ence at the top and Combined Reference Centers referring questions to the 
top); (2) the regional nodel without super re*Ference, but with a few desig- 
nated Augmented Reference Centers which would provide advanced-state-of -the- 
practice reference to the Combined Reference Centers; and (3) the supermarket 
model, which allowed libraries to go to wherever th^y chose to get informa- 
tion. Participants were told to use the data collected during the study and 
to refer to the working hypotheses as they discussed the merits of each of 
their models. They were free to switch to ons of the other three models, cr 
to combine models, provided they had discussed why the model they were 
assigned was not workable. They were asked to create a list of trade-offs 
which they considered when they discussed their model. They were also asked 
to rank the functions (see Tables A and 5), 

The Augmented Regional Reference Center Model was the model of choice (in both 
the blue and gray sky scenarios) for most of the participants. Those who fa- 
vored the Pyramid Model, in the gray sky scenario, assumed that less super 
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reference would be available, and nore advanced-state-of-the-practice refer- 
ence wc*ild b?? delivered. Indeed, all three groups, even in the blue sky 
scenarirr. opted fcr less super reference and ©ore advanced-state-of -the- 
practice reference. However, there was strong support for maintaining some 
capacity for super reference, but at a reduced level. 

There was also somp strong interest in the supermarket Dodel, especially at 
xhe Cerritos meeting. Following the sieeting, a nunber of letters Here sent to 
the consultant (from directors of libraries in the Los Angeles area) which 
spoke on behalf of the supermarket model. As envisioned, the model would al- 
low libraries either to go to a designated regional center, or to any inforwa- 
tion provider for super reference, or advanced-state-of -the-practi ce refer- 
ence, ft reimbursement mechanism would be set up to compensate non-public li- 
brary participants. In one scenario, an expediter at the State Library would 
handle the routing of questions to the appropriate resource. 

The difficulties with the supermarket nodel as a major mechanism for providing 
reference referral are: (I) the number of potential providers is unknown, (2) 
the likelihood is that there would be a wide number of providers, making it 
difficult to monitor performance and predict costs, and (3) there would likely 
not be sufficient funds to support the Combined Reference Centers, violating 
the principle of statewide access. In any case, the other two models do not 
pr4fclude a supermarket approach to suppleaent reference resources provided by 
the Combined Reference Centers. 

In assigning priorities to reference functions, all the groups ranked question 
handling first and allocated between 60-80% of all funds to this function. Oi 
that amount, most groups allocated only lOZ of question handling funds to 
super reference, with the remainder allocated to advanced-state-of -the-pr ac- 
tice and state-of -the-practi ce reference. The second ranked function was edu'^ 
cation and training, which had a slight edge on developing specialized re- 
sources in some cases (it was tied in several groups) for the use of the re- 
maining 257. of the funds. Duality control was not identified as a separate 
function since it was incorporated into the delivery of question handling, 
education and training, and developing specialized resources. A description 
of the Augmented Regional Reference Center Model that the majority of partici- 
pants supported follows. 



Reoional ftt^ference Center Model (Gray S\-v Scenario) 

There would be fewer System Reference Centers than there are now. They ^ 
be located in strong host collections. They would be located predominant 
but not necessarily exclusively, in public libraries; they could also bs in 
academic libraries, for example. There would be a high level of interaction 
between Centers. Willingness to reduce geographic proximity to the local 
libraries served by the Reference Center was traded of in return for access to 
stronger reference resources for question handling. 

The following summarizes the regional group discussions of the Combined Refer- 
ence Center functions: 
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Question Handl ing: 



Deliver advanced-state-of -the-practi ce question handling roost of the 
time Nith a little super reference (around 10'/.) in addition. 

Likely to have a specialized subject focus for question handling. 
Education and Training: 

None; it would be left to the Systf.^^.. 

Developing Specialized Resources: 

Develop the subject strengths of their collr ':.vn5 to improve 
question handling in specialized subject d> 

Produce useful newsletters and finding tuu/ on a subscription basis 
to cover the costs. A great concern for having such services as 
Bare Notes, Scan Updates , and Scanni nqs conti nue, but on a subscrip- 
tion basis. 

Maintain (and automate) specialized "info files." 

Reference resources would be augmented by the existing multi-type 
networks that have been developed by Systems in some regions of the 
state. A reimbursement mechanism would be needed. The funds to 
compensate question handling by non-public libraries would cither 
come from the local level as supplemental funding for extra service, 
or from the existing CLSA funds. 

Qual i ty Control : 

Incorporated into the otl'^r three functions above. Not explicit, 
but a concern which was ^>,presse;: in terms of where the leadership 
for the system would lie, local control, communications and 
delivery, protocols for communications. Concern about turn-around 
time. 

Other Factors 

The Systems would remain intact and continue to provide education 
anv "raining and to develop specialized resources. 

Thert will be co'^ts (both time and mon^?v) associated with makinQ 
change. 

The pyramid model was perceived a& having the oiost local control. 



- 50 - 



70 



III. DATA COLLECTION AND ANALYSIS 



This section discusses the need ^o^ data to analyze reference referral, the 
problems with past da'ca gathering, and the surveys conducted as part of the 
study. Finally, there is a discussion of the survey n?sultE. 



8. DATA NEEDS AND PROBLEMS 



8. 1 Evaluation of Questions Handled bv BARC and SCAN 

The Ad Hoc Reference Committee, at the request of tt Select Committee, re- 
viewed 4,000 questions received by BARC and SCAN in FY 1985. They determined 
that there was not enough information on the questions to evaluate whether 
they were "super reference" level questions, or lower level questions, i.e., 
garden variety, state-of -the-pr acti ce, or advanced-state-of -the-practi ce ref- 
erence questions. Furthermore, it was apparent that the performance require- 
ments, established by the CLSB in the CLSA regulations, created an incentive 
for System Reference Centers to refer questions to BARC and SCAN (i.e., turn-- 
around 70V. of questions within 10 working days, and answer 90V. of questions 
referred from member libraries). There was no ^'3quirement that the questions 
referred needed to be at the super reference level. 

The Ad Hoc Reference Committee concluded that the current hierarchical refer- 
ence referral system and the variations in both local and system reference 
center resources (collections and staff) resulted in a variety of levels of 
questions being referred to BARC and SCAN. It was assumed, however, that the 
majority of questions were above the stat e-of -the-pr act i ce level. The Ad Hoc 
Committee members decided that it would be nore productive to gather data on 
the types of resources being used to answer questions, and the costs of ques- 
tion handling than to look at the questions themselves. The Select Committee 
turned its attention to identifying what data should be collected in the 
course of the study. A description of these questionnaires appears below. 
Sample questionnaires appear in Volume II. 

8p2 Definition Probleuis in Data Collection 

It is worth noting that both the Pe;M, Warwick and the King studies stressed 
; " need for standardizing the correction of library data in California. 
While some improvements have been ead^^ since that time, there is still confu- 
sion in the field concerning what to count as a reference transaction, and how 
to count it (e.g., if it is incomplete, or took a ' v*^ time to answer). The 
State Library asks all public libraries in the st&lc? to provide data annually 
on a number variables, including "Reference" and "ILL borrow," and "ILL lent." 
These data appear in the annual, California Library Statistics . It also asks 
BARC, SCAN and the systems to report on their reference transactions, but ap- 
parently without providing them with working definitions. 
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The State Library's definitions and instructions to the public libraries pre- 
sent problems. To begin with;, the ILL count is "to include photocopies sent 
in lieu oi ILL." But what ii the phoLo/ropy is in response to an Interlibrary 
Reference (ILR) question? Should it ba rtunted as an ILL, or as a reference 
question? Or both? Part of the problem u^-tb is that there are no instruc- 
tions for ILR transactions,, and, as a result^ many reference librarians be-- 
lieve that ILL and ILR data are intermixed. 

The second major problem is that the State's definition oi reference stresses 
the "annual total of questions answered by reporting library." As has been 
made clear in this study, all questions are "handled" — whether or not they 
are answered in part, in full, or not at all (e.g., the library has a policy 
that certain types of questions will not be answered). The reporting library 
is in the dark about how to count questions, given these important distinc- 
tions. To the State Library's credit, it does instruct that a negw..ve re- 
sponse that is satisfactory to a patron should be counted as an answer. 

Thirdly, there is the issue of double counting as a result of the reference 
referral process. By definition, reference referral suggests that more than 
one library has had a hand in handling any given referred question, but there 
are no instructions on how to count the effort invested in trying to answer 
the question by more than one library. What if the answer is provided by 
another source, as is often the case with questions referred to BARC and SCAN? 
Do the local public libraries and System Reference Centers take credit and add 
these answers to answers to other questions they were able to provide them- 
selves? It may be appropriate to do so, but not without instructions. 

All of these problems multiply when looking at the data collected by the Sys- * 
tem Reference Centers and by BARC and SCAN. Much of the controversy over the 
State Library's "Staff Study on Third Level Reference" was rightly centered on 
the way the State Library staff used data to arrive at conclusions and recom" 
mendations. Those who were concerned correctly perceived that the numerator 
and the denominator used to calculate productivity of each of the System Ref- 
erence Centers and of BARC and SCAN were each arrived at independently of the 
other . 

Evidently SCANr and to sone degree BARC (based on a conversation with Faun 
Mclnnis Juna 23, 1986), determine that what appears to be one referred ques- 
tion is really two or more questions. Jtnd count them as such. Consequ ent 1 y« 
BARC and SCAN . t, orted that they handled 5,500 questions in FY 1 '^BS, and yet 
the System Reference Centers only report referring 4000 questions. Both fi- 
gures are legitimate, but one must be careful in mi)MnQ then. 

Had there been uniform reporting standards, the level of misunderstanding and 
the possibility of incorrect interpretation of the data could have been 
avoided. 
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B,3 Study Questionnaires 



When the scope of the study expanded to include the System Reference Centers, 
the intent was to compare them with one another and with BARC and SCAN. The 
pjpints of comparison that seened likely to be most revealing were; (1) infor- 
mation on the cost of question handling at each of the 17 System Reference 
Centers; (2) information on the cost of question handling at BARC and at SCAN; 
and (3) the nature of the resources available for question handling at each 
System Reference Center and at BARC and SCAN. Unfortunately, none of this 
information was available without collecting original data. 

As an example«of the problems of computing coaparative data on the cost of 
question handling, consider the following example. BARC and SCAN estimated 
that it cost them roughly $150 per answer exclusive of indirect costs. Infor- 
mation on Demand, a Berkeley-based information broker, arrived at nearly the 
same figure for its services exclusive of indirect costs, as well. But BARC 
and scan's calculations appeared to have been based on assigning all their 
costs to the question handling function when, in fact, they invested signifi- 
cant tirn^ and resources in providing implicit quality control for question 
handling, in doing some education and training, and in developing some spe- 
ci ali zed resources. 

Since question handling is an art and not a science, we had no way of com- 
paring the quality of thi? answers, or the attempt to provide answers, pro- 
vided by each System Rercrence Center and by BARC and SCAN. Yet we had been 
told that the Reference Centers were so different that it would be difficult 
to generalize about them. It eeemed appropriate, therefore, to detert:)!ne what 
made them so different, apart from their geographic location and the tremen-- 
dous variations in wealth of the local jurisdictions, region by region, in 
Cal if orni a. 

Consequently, it t^as important to find out what mix of staff were being used 
at each of the 19 locations (including BPRC and SCAN), what level of education 
they had obtained, years of experience at their present job, and prior rele- 
vant experience, such as number of years working for the host and therefore 
mastering the host's collection. We also wanted similar information about the 
host's own reference staff, since they represent reference resources available 
for consultation by the System Reference Centers as well. 

We also wanted to knoN about the other reference resources at the host's cen- 
tral location, including the size and rate of growth of the reference collec** 
tion, the periodical collection, the government documents collection, and the 
general coHection. Me also wanted to know whether data base searching and 
use of telephone for inquiry were available and considered part of tn:? hosts' 
reference resources. 

Unfortunately, the annual statistics collected by the California State Library 
on public library collections reports^ aggregate data for the entire public li- 
brary system. We wanted to know the extent of resources readily available at 
the central location to the 17 Reference Centers and to BARC and SCAN who were 
housed there. 
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The only Nay to assign costs properly to questic) handling Mas to design a 
questionnaire to send to the 17 Reference Centers and to BARC and SCAN. The 
same Mas true ior learning about the resources available at the hosts' central 
location. Although the study consultant had stated explicitly in the January 
19B6 propo&al to the California State Library, that the physical collection oi 
data was outside the scope oi the proposal, it was evident that decision mak- 
ing Mould be greatly improved Mere these data available. 

Consequently, tMO questionnaires Mere produced and ciailed out in April to the 
17 Reference Centers, to BARC and SCAN, to the 18 host libraries, and to 27 
potential hosts (i.e. libraries, Mho reported in the 1985 California Library 
Statistics t hat their system had 400,000 volumes or nore). These potential 
hosts seemed likely candidates to have strong reference resources located in a 
central location. It seemed Morth Mhile to take a look at other libraries 
Nhose collections might be as strong or stronger than those at an existing 
host • 

Fortunately, the consultant Mas ably assisted in drafting the questionnaires 
by the three members of the Ad Hoc Reference Committee, Mho met for one full 
day in San Diego to discuss data collection and analysis. Kenbers of the 
Select Committee and several of the participants at the focus group meeting in 
Santa Monica also critiqued the draft questionnaires. Because of the State 
Library's rigid timetable for the study, there Mas not sufficient time avail- 
able to pretest the questionnaires. 

In the cover letter to the questionnaire, we attempted to reassure respon- 
dents. He stated that we understood that some of the data they reported Mould 
be "soft" (i.e. based on estimates), either because they had so little time to 
complete the survey, or because the data Me requested Mere not ordinarily col- 
lected. We explained that the value of the data Mas to get a sense of the or- 
dpr of magnitude of costs and reference resources, in order to improve the de- 
i' .&ion making of participants in the study process. Precision was ouch less 
important, since even errors of 10-15'/. were unlikely to affect any given 
respondent's ranking, when compared to other respondents. 

In an extraordinary show of commitment, everyone completed their survey form. 
Furthermore, they all met the severe time constraint which gave them less than 
two weeks in Mhich to respond. No pollster could have hoped for such a re- 
sponse rate. Questionnaires Mere sent to: 

0 All 17 of the System Reference Centers and BARC and SCAN. 

0 fill 17 of the Hosts in Mhich the System Reference Centers are based. 
MDBAC requested that Salinas Public Library be designated as their 
host^ although KDBAC is based in Monterey Peninsula College. North 
State reque'-ted that Me also include California State University, 
Chico, because they Mere considering using this campus as a host in 
the future. 

0 27 Potential Hosts received questionnaires. Sixteen had central col- 
lections Mith an estimated combined general and reference collection 
of over 100,000 volumes. They had on average over one thousand per- 
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iodical titles, sone h^.d governinent docunents and data base search- 
ing. These Here considei^en potential hosts. Cali-fornia State Uni- 
versity'j Chico, has been included as a potential host at the request 
of North State Cooperative Library System which has been experiment- 
ing with using that collection as a reference resource. 

0 Eleven potential host libraries were excluded either because they had 
no central collection, because the collection Has too small to be 
considered, or because the collection was limited to one subject (as 
Has the case with branch collections reported by Los Angeles County 
Public Library and Oakland Public Library). In the case of these 
special collections, they should certainly be included in any study 
of specialized collections in the state. 

Sample copies of th^: l«vo questionnaires appear in Volume II. A complete set 
of tables reporting ^'^i the data appears in an Appendix to Volume I. Table 2 
lists host libraries 2nd Table 3 lists potential hosts. 



9. SURVEY DATA 

The following discussion provides a brief description of Survey Tables I to 
IX, which summarize the data from the questionnaires. 

Survey Table I: Detailed Expenditures by Functional Categories: Reference 
Centers, BARC, and SCAN (FY 1985): 

table I is in fact 17 tables which display data reported by each of the 
Reference Centers on the matrix on page six of the survey questionnaire. 
These data are used to create Survey Tables 11,111 and VI. 



Survey Table II: Allocation of Expenditures by Reference Function (FY 1985): 
Reference Centers/BARC/SCAN: 

These data summarize actual expenditures, not budget projections. The total 
system expenditures cone to $1,608,500, which is $57,868 sore than reported in 
Table I above. Note that North State is broken down into three separate en- 
tries (Butte, Eureka, and Shasta), since North State has three separate cen- 
ters and three separate hosts. 

Compare column 2 with column 1 to determine how much was spent for the ques- 
tion answering function vs. the total expenditure both by system and for all 
17 Reference Centers. For example, I1CLS spent $155,500 on question handling 
out of a total expenditure of $240,100). Column 6, shoMS what percentage ques- 
tion handling (DH) is of the total (lOOV.) of the four functions listed in col- 
umns 6-9 (example QH constitutes 64.87. of MCLS' total expenditures). It is 
possible to make the same kind of dollar comparison for each of the other 
functions (columns 3, 4, and 5) in each System and the shares of expenditures 
made in each Reference Center for each function. For example HCL5 spends 
$20,100 on El^T, or 8.47. of its last year's total expenditures. 
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Secondly, by adding up all the coluffins, it is possible to compare total dol- 
lars and percent shares to the information reported by BARC and SCAN at the 
bottom oi the table. These data provide an insight into the May existing dol- 
lars are currently being allocated. The $1,608,500 total expenditures for the 
systems broken down by percentage shares (columns 6-9) come to 63.57. for Ques- 
tion Handling(DH) 9.4'/ for Education and Training and Quality Control <EM), 
9.77. for Developing Specialized Resources (DSR), and 17.37. for All Other 
(which includes Service to the Underserved) 



Survey Table III: Question Handling Comparisons (FY 1985): Reference 
Centers/BARC/SCAN 

This table is inportant because it provides unit cost per question received, 
arrayed by system (column 6) and ranked (column 11). It show how each system 
ranks in terms of questions received (colu?nn 7, Hhich is based on column 1). 

In the rankings that appear in columns 7-11, in order to make it possible to 
coiTipare ranks across columns, ties are scored by adding the tie scores, and 
dividing by the nu/tiber of ties to get the average rank, which is assigned to 
all the ties, and then skipping to the next number not used in creating the 
average to resume ranking. For example, if there are two scores of 2, you 
add the scores which are 2+3, divide by 2, assign 2.5 to each, and then re- 
sume numbering other scores by starting with 4). 



Survey Table IV. Profiles All Staffs Reference Centers/BARC/SCAN (FY 1986) 

This table gives sodp feeling for the skill base at the system reference cen- 
ters. Column 1 shows the total number of staff and colunns 3^6 shows the com- 
position of staff working in the reference center in each systen) in percentage 
terms across columns (to total 1007. for each systea): professionals (full time 
and part time) and support (full time and part time). Column 2 shows how (nany 
of the total in column 1 are professionals. Columns 7-8 give information on 
the average years of experience for the professionals listed in column 1. The 
breakdown is "reference experience" column 7, the combined average years of 
experience in the H(ost) and RC (Reference Center). There may be a trade off 
between experience and staff staying too long, becoming too costly because of 
seniority, stagnating, and becoming set in their ways. As in the tables 
above, it is important to look at the averages for each column which sumrriarize 
the 17 systems and then compare these averages with BARC and SCAN data at the 
bottom of the table. 



Survey Table V: Staff Profile of Professionals: Reference Centers/BARC/SCAN 
(FY 1986) 

This table takes a closer look at the professionals and tries to get at 
several important elements; the amount of training, i.e., how professional 
(column 4) and column 5 which shows advanced degrees above the MLS, which 
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might equate to "expertise." The data on years oi experience, arrayed in 
Survey Table IV, is carried over here (columns 6-B) . 

Survey Table VI: Question Handling Statistics, Staff and Costs: Reference 
Centers/BARC/SCAN (FY 1985) 

This table shows the number of questions received that each professional staff 
person handles (column 5), as well as the number of questions answered by each 
staff (column 9). This way we can arrive at a concept of "load," i.e., how 
many questions each professional can handle. This, of course, does not give 
us any idea about quality of the answer, but we have largely Bide stepped this 
issue, and address it only via host resources available and experience and ed- 
ucational level of Reference Cenier staff. It is interesting to see that the 
average » of questions for all systems, handled by professional staff comes 
to 1,569, as compared to an average of 711 for BARC and SCAN. 



Survey Table VII: Host/Potential Host L.braries (Map) 

This is a nap showing the physical location of hosts and potential hosts in 
California (prepared by James Henson, California State Library). 

Survey Table VIII: Total Collection and Staff: Host Libraries (FY 1985) 

The motivation for gathering these data (and Table IX, which follows) was to 
assess the strength (i.e., expressed in numbers of volumes or items) of refer- 
ence resources available to the System Reference Center at the host's, or po- 
tential host's center. Note that the data on collections and expenditures at 
the central location are mostly soft (i.e., estimated). The California State 
Library does not ask libraries to report data for a single central location; 
data are reported for the entire system. Nonetheless, the data provide or- 
ders of magnitude for each central location and make it possible to comparable 
one host collection with another. Bear in nind that the definition of total 
collection is: the sum of the general collection, reference collection, per- 
iodical titles, government documents, and staff FTEs. 

Survey Table IX: Total Collection and Staff: Potential Host Libraries 
(FY 1985) 

Potential host libraries r'sre selected by sending questionnaires to all li- 
braries that reported total holdings of 400,000 volumes, or more, in Cal if or- 
nia Library Statistics. 1985 and were not already hosts (400,000 volumes was 
chosen as a cut off by James Henson, California State Library, based on the Ad 
Hoc Reference Committee's and the Study Consultant's request to identify those 
public libraries which were likely to have large central collections). The 
intent was to identify some libraries with large reference resources in a cen- 
tral location which might serve as hosts in the future. 




As was true with the hosts, the data on collections and expendi tures at the 
central location are mostly "soU" (i.e.^ estinated), since the California 
State Library does not ask libraries to report for a single location, but ra- 
ther to report data ior the entire system. Nonetheless, the data give orders 
of magnitude ior each central location and nalce it possible to compare poten- 
tial host collections with existing host collections (by comparing tables \Hl\ 
and IX). The list of potentia."! hosts to whom questionnaires were sent appears 
as Table 3. The data from starred libraries were not analyzed because the 
collection was either too small, or there was no central location (i.e, some 
county library systems do not have one collection that serves as the "main" 
coll ect i on ) . 
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TABLE DF SURVEY TABLES 

Survey Tables on Re^erencB Cgnters, BARC and SCAN : 

Survey Table I: Detailed Expenditures by Functional Categories (FY 1985) 

Survey Table II: Allocation O'f Expenditures by Re'ference Function (FY 
1985) 

Survey Table III: Question Handling Comparisons (FY 1985) 

Survey Table IV: Profiles - All Sta44 (FY 1985) 

Survey Table V: Staii Profiles, Professionals ( FY 1986) 

Survey Table VI: Question Handling Statistics, Staff and uosts (FY 1985) 

Survey Tables on Hosts and Potential Hosts ; 

Survey Table VII: Host/Potential Host Libraries (hap) 

Survey Table VIII: Total Collection and Staff: Host Libraries (FY 1985) 
Survey Table IX: Total Staff and Collection: Potential Hosts (FY 1985) 
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SURVEY TABLE 1: 
Detailed Expenditures by Functional Categories: 
Reference Centers, BARC, and SCAN 
(FY 1985) 



Notes: 

Staff Costs were allocated to functional categories using the shares of staff 
time allocated to each activity, as reported on p^^ge 6 of the survey question 
naire. Other direct costs Here allocated according to reported shares. Indi 
rect costs were allocated according to v\ -rage shares of all direct costs. 



So 



BALIS 







Total 
(1) 


Ouestion 
AnsNering 
(2) 


Education, 
Training, 
Oual Con 
(3) 


L'jvelo|) 
Specialized 
Resources 
(4) 


iST'.'ing 
Under- 
served 
(5) 


All 

Othp.- 
(6) 


II. 

4. 
5. 
6. 


Direct salaries I benefits 
Professional eaployees 
Contract labor 
Support staff 


^ 51.7 
32.0 
12.0 


^42.9 
.0 
3.0 


+ 2.1 
.6 
.4 


4 1.0 
.0 

3.0 


4 1.0 
1.6 
.1 


f4.7 
29.B 
5.5 


III. 


Other direct costs 














8. 


Data-base searching 
Total costs 


1.7 


1.7 


.0 


.0 


.0 


.0 


9. 


Telephone 


2.0 


1.6 


.1 


.1 


.1 


.1 


10. 


Reference aaterials 

10b For host collection 
iOc For center collection 


.4 
.0 
.4 


.4 
.0 
.4 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


n. 

12. 


Supplies and equipaent 
Other 


6.3 
4.2 


3.1 
2.5 


1.9 
.6 


.6 
.2 


.6 
.6 


.0 
.0 




SUBTOTAL 


110.2 


55.2 


5.9 


5.0 


4.2 


40.0 


IV. 

It 

V. 


Indirect costs 
Total expenditures 


4 liO.2 


^55.2 




.0 


.0 

A A 'i 
44.2 


A 

>4U.O 






Black Gold Inforaation Center 












Total 
(1) 


Ouestion 
AnsMering 
(2) 


Education, 
Training, 
Oual Con 
(3) 


Develop 
Specialized 
Kcsources 
(4) 


Serving 
Under- 
served 
(5) 


All 

nf knr 

umer 
(6) 


II. 
4. 
5. 
6. 


Direct salaries I benefits 
Professional eaployees 
Contract labor 
bupport staff 


^ 56.0 
.0 
18.9 


i28.0 
.0 
11.3 


4 B.4 
.0 
1.9 


42.8 
.0 

0 

.7 


44.2 

.0 

0 
.7 


4 12.6 
.0 

w« 0 


III. 


Other direct costs 














Q 

0. 


Data-base searching 

T0C31 costs 


3.2 


2.9 


.1 




1 

• 1 


A 
• U 


9. 


Telephone 


4.5 


2.5 


.2 


.0 


.5 


1.4 


10. 


Reference aaterials 

10b For host collection 
10c For center collection 


2.0 
.0 
2.0 


2.0 
.0 

2.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


11. 
12. 


Supplies and equipaent 
Other 


11.6 
1.0 


4.6 
.1 


1.2 
.1 


1.2 
.1 


1.2 
.1 


3.5 
.6 




SUBTOTAL 


9/. 2 


51.4 


11.9 


5.1 


7.0 


21. B 


IV. 
V. 


Indirect costs 
Total expenditures 


^97.2 


.0 

^51.4 


.0 

.^11.9 


.0 
45.1 


47.0 


.0 

421.B 
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49-99 Cooperative Library Systee 







Total 
(1) 


Question 
AnsNerino 
(2) 


Edur^t i on. 

bWUbSWI Will 

Training, 
Dual Con 

(3) 


DpvpI DD 

Specialized 
Resources 
(4) 


Sprvi no 
Under- 
served 
(5) 


All 
Other 
(6) 


11. 

4, 

S. 
6. 


Direcl salaries l benefits 
Professional eiDlovees 
Contract labor 
Support staff 


^35 B 

< WW ■ D 

.0 
21.0 


432.3 
.0 

19.3 


il.4 
* .0 
.8 


i 1 1 
* .0 
.0 


^ 0 
.0 
.0 


4 1.1 
^ .0 
.8 


111. 


Other direct costs 














B. 


Data-base searching 
Total costs 


.9 


.9 


.0 


.0 


.0 


.0 


9. 


Telephone 


2A 


2.2 


.2 


.0 


.0 


.0 


10. 


Reference taterials 

10b For host collection 
10c For center collection 


6.1 
S.& 
.5 


.0 
.0 
.0 


.0 
.0 
.0 


6.1 
S.6 
.5 


.0 
.0 
.0 


.0 
.0 
.0 


11. 
12. 


Supplies and equipient 
Other 


1.0 
.0 


1.0 
.0 


.0 
.0 


.0 
.0 


.0 
.0 


.0 
.0 




SUBTOTAL 


67.2 


55. 6 


2.6 


7.2 


.0 


1.9 


IV. 
V. 


Indirect costs 
Total expenditures 


, 3.6 
4 70.B 


. 3.0 
458.6 


t 2.7 






. .1 

i- 2.0 



Inland Library Systei 







Total 
(1) 


Question 
AnsNering 
(2) 


Education, 
Training, 
Dual Con 
(3) 


Develop 
Specialized 
Resources 
(4) 


Serving 
Under- 
served 
(5) 


All 
other 
(6) 


II. 


Dirftt salaries l benefits 


V69.6 


i 52.2 


44.2 


44.2 




4 9.1 


4. 


Professional eaployees 


5. 


Contract labor 


.0 


.0 


.0 


.0 


.0 


.0 


b. 


Support staff 


16.0 


14.4 


.0 


.0 


.0 


1.6 


III. 


Other direct costs 














e. 


Data-base searching 








.0 


.0 




Total costs 


2.0 


• , '"• 


.0 


.0 


9. 


Telephone 


5.C 


2.3 


.8 


.1 


.0 


2.0 


10. 


Reference taterials 


9.0 


.0 


.0 


.0 


.0 


.0 




10b For host collection 


9.0 


.0 


.0 


.0 


.0 


.0 




10c For center collection 


.0 


.0 


.0 


.0 


.0 


.0 


11. 


Supplies and equipient 


3.1 


2.7 


.2 


.2 


.0 


.0 


12. 


Other 


5.6 


4.9 


.3 


.3 


.0 


.0 




SUBTOTAL 


110.3 


78.5 


5.5 


4.8 


.0 


12.6 


IV. 


Indirect costs 


1.6 


1.1 


.1 


.1 


.0 


.2 


V. 


Total expenditures 


4 111.9 


^ 79.6 


5.6 


4 4.8 


4.0 


f 12. B 
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HCLS 





Total 
(1) 


Education, 
Question Training, Si 
AnsMering Dual Con 1 
(2) (3) 


Develop 
isoalized 
Resources 
(4) 


Serving 
Under- 
served 
(5) 


All 
other 
(6) 


II. Direct salaries 1 benefits 

4. Professional eaployces 

5. Contract labor 

6. Support staff 


4> 178.4 
^ .0 
23.4 


.0 
15.2 


y 10. 1 
.0 
2.3 


*10.7 
.0 
4.7 


il2.5 
.0 
1.2 


48.9 
.0 

aU 


III. Other direct costs 














Data-b.^se searching 

R Total ^Dsts 


6.5 


.0 


.0 


.0 


.0 


.0 


9* Telephone 


7.8 


6.5 


.2 


.2 


.8 


.2 


10* Reference paterials 

10b For host collection 
10c For center collection 


16.5 
16.0 
.5 


.5 
.0 
.5 


.0 
.0 
.0 


.0 
.0 
.0 


16.0 
16.0 
.0 


.0 
.0 
.0 


11. Supplies and squipaent 


4.5 

3.0 


2.3 
.9 


.9 
.6 


.9 
.3 


.5 
1.2 


.0 
.0 


SUBTOTAL 


240.1 


155.5 


20.1 


16.7 


32.1 


9.1 


IV. Indirect costs 

V. Total expenditures 


, .0 
> 240.1 

RDBAl 


4 155.5 


.0 

120.1 


.0 

^ 16.7 


.0 

> 32. 1 


.0 

J: 0 1 




Total 
(1) 


Question 
Answering 
(2) 


Education, Develop 
Training, Specialized 
Dual Con Resources 
(3) (4) 


Serving 
Under- 
served 
(5) 


All 

(6) 


II. Direct salaries & benefits 

4. Professional eeployees 

5. Contract labor 

6. Support staff 


439.2 
6.7 
4.0 


\ 1 / . O 

6.7 
.0 


i7.B 
.0 
.6 


i5.9 
.0 
.B 


43.9 
.0 


|3.9 
.0 


III. Other direct costs 














Data-base searching 
6. Total costs 




1.4 


..0 


.0 


A 
. U 


A 

.V 


9. Telephone 


1.0 


.5 


.0 


.0 


.0 


.5 


10. Reference naterials 

10b For host collection 
10c For center collection 


3.1 
1.0 
2.1 


1.4 
.5 
1.0 


.0 
.0 
.0 


1.4 
.5 
1.0 


.3 
.1 
.2 


.0 
.0 
.0 


IL Supplies and equipaent 
12. Otbsr 


3.0 
6.1 


.3 
2.4 


1.2 
2.7 


1.2 
.9 


.3 
.0 


.0 
.0 


SUBTOTAL 


64.5 


30.4 


12.6 


10.2 


4.9 


6.4 


IV. Indirect costs 

V. Total expenditures 


1.0 
1^65.5 


.5 

^30. 9 


.2 

^i2.B 


, .2 
^10.4 


.1 

4 5.0 


. .1 
46.5 



nVLS: fountain Valley Inforiation Center 







Total 
(1) 


Question 
AnsHering 
(2) 


Education, 
Training, 
Dual Con 

(3) 


Develop 
Specialized 
Resources 
(4) 


Serving 
Under- 
served 
(5) 


All 
Other 
(6) 




Ii^ect salaries I benefits 
r^fessional eiployees 
.ontract labor 
Support staff 


:)> 62.7 
.0 
li.7 


•f45.5 
.0 
15.0 


47.5 
.0 
.8 


H 

.0 
.0 


.0 
.0 


^9.7 
.0 

.e 


III. 


Other direct costs 














e. 


Data-base searching 
Total costs 


3.6 


3.6 


.0 


.0 


.0 


.0 


9. 


Telephone 


2.0 


1.6 


.1 


.0 


.0 


.1 


10. 


Reference laterials 

10b For host collection 
10c For center collection 


1.9 
.0 
1.9 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


11. 

17 


Supplies and equipaent 

nf nor 


3.4 

12.5 


1.7 
2.5 


.9 
6.3 


.0 

A 
• V 


.0 

A 
• U 


O.u 




SUBTOTAL 


103.0 


70.3 


15.6 


.0 


.0 


15.3 


IV. 
V. 


Indirect costs 
Total expenditures 


1.6 
^ 104.6 


\ 71.4 


.2 

^15.B 


,0 


.0 


.2 

415.5 






North Bay Cooperative Library Systea 












Total 
(1) 


Question 
AnsMering 
(2) 


Education, 
Training, 
Qual Con 
(3) 


Develop 
Specialized 
Resources 
(4) 


Serving 
Under- 
«erved 
(5) 


All 
Other 
(6) 


II. 

4. 

5. 
6. 


Direct salaries d benefits 
Professional eaployees 
Contract kbor 
Support staff 


46.B 
2.2 
10.2 


^26.1 
.0 
7.7 


^.7 
2.2 
.0 


^2.3 
.0 
.5 


i4.7 
.0 
.5 


^7.0 
.0 

1.5 


III. 


Other direct costs 














e. 


Data-base tsarching 
Total costs 


5.h 


5.3 


.1 


.1 


.1 


.0 


9. 


Telephone 


2.4 


1<2 


.5 


.2 


.2 


.2 


10. 


Reference laterialt 

10b For host collection 
10c For center collection 


11.1 
9.1 
2.0 


10.6 
9.1 
1.5 


.1 
.0 
.1 


.3 
.0 
.3 


.1 
.0 
.1 


.0 
.0 
.0 


11. 
12. 


Supplies and equipiient 
Other 


l&.O 
.9 


4.6 

.0 


3.0 
.0 


1.3 
.0 


3.7 
.9 


3.4 

.0 




SUBTOTAL 


95.2 


57.5 


10.6 


4.7 


10.2 


12.2 


IV. 
V. 


Indirect costs 
Total expenditures 


3.6 


2.2 
459.7 


.4 

if 11.0 


.2 
44.9 


^10*. 6 


412.6 



84 



North State-Butte 







Totdl 
(1) 


Question 
AnsNerino 
(2) " 


Education. 
Training, 
Bual Con 
(3) 


Devel op 
Specialized 
Resources 
(4) 


SirvinQ 
Undtr- 
ierved 
(5) 


All 
Other 
(6) 


n. 

4. 

5. 
i. 


Direct salaries benefits 

1 1 U1C33iUII01 CVp&UJCO 

Contract labor 
Support staff 


^2B.7 
.0 
7.7 


^ 17.8 
.0 
7.0 


^ 3.7 
.0 
.B 


i2.Z 
.0 
.0 


.0 
.0 


M.9 
.0 
.0 


III. 


Other direct costs 














8. 


Datd-base searching 
Total costs 


2.5 


2.5 


.0 


.0 


.0 


.0 


9. 


Telephone 


1.3 


.1 


.7 


.0 


.0 


.5 


10. 


R'-'^rence laterials 

iiOb For host collection 
10c For center collection 


5.4 
5.4 
.0 


5.4 
5.4 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


11. 

12. 


Supplies and equipient 

Othsr 


1.4 

1.0 


.& 

.0 


.1 
1.0 


.1 

.0 


.0 
.0 


.7 
.0 




SUBTOTAL 


48.1 


33.4 


6.2 


2.4 


.0 


&.1 


IV. 
V. 


Indirect costs 
Total expenditures 


. 5.1 
\ 53.2 


3.5 
■♦.36.9 


.7 

^ 6.9 


.2 

4 2.6 


.0 
^0 


.6 
i 6.8 






North State-Eureka 














Total 
(1) 


AnsxeritiQ 
(2) 


Education, 
Training, 
flual Con 
13) 


Develop 
Specialized 
Resources 
(4) 


Serving 
Undfc- 
terved 
(5) 


All 
Other 
(6) 


11. 
<. 

5. 
b. 


Direct salaries I benefits 
Professional eiployees 
Contract labor 
Support staff 


4 1.3 
.0 
1.1 


^1.3 
.0 
t.l 


Jt.o 

.0 
.0 


it.o 

.0 
.0 


.0 
.0 


J^.O 
.0 
.0 


III. 


Other direct costs 














8. 


Data*base searching 
Total costs 


.0 


.0 


.0 


.0 


.0 


.0 


9. 


Telephone 


1.3 


1.3 


.0 


.0 


.0 


.0 


10. 


Reference laterials 

10b For host collection 
10c For center collection 


5.4 
5.4 
.0 


5.4 
5.4 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


11. 
12. 


Supplies and equipient 
Other 


1.4 
.4 


1.4 
.0 


.0 
.4 


.0 
.0 


.0 
.0 


.0 
.0 




SUBTOTAL 


10.9 


10.6 


.4 


.0 


.0 


.0 


IV. 
V. 


Indirect costs 
Total expenditures 


il2.7 


1.7 
^ 12.2 


.1 


.0 
^.0 


.0 
+ .0 


.0 
^.0 



■'■85 



North State-Shasta 







Total 
(1) 


CueEition 
Ansxprinu 
(2) ^ 


Educati on, 
Training, 
Sual Con 
(3) 


Develop 
Specialized 
Resources 
(4) 


Serving 
Under- 
served 
(S) 


All 
Other 
(6) 


II. 

4. 

S. 
6. 


Direct salaries I benefits 
Professional employees 
Contract labor 
Support staff 


i 22.9 
.0 
4.9 


* 13.7 
.0 
3.0 


il.l 
^ .0 
.5 


i 1.1 
^ .0 
1.5 


.0 
.0 


i 6.9 
.0 
.0 


III. 


Other direct costs 














B. 


Data-base searching 
Total costs 


1.3 


.6 


.0 


.0 


.0 


,7 


9. 


Telephone 


1.3 


.1 


.7 


1.3 


.0 


.5 


10. 


Reference aaterials 

10b For host collection 
10c For center collection 


5.4 
5.4 

.0 


5.3 
5.3 
.0 


.1 
.1 
.0 


.0 

.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


U. 
12. 


Supplies and equipment 
Other 


1.4 

1.0 


.6 

.0 


.1 
1.0 


.1 

.0 


.0 
.0 


.7 

.0 




SUBTOTAL 


38.2 


23.3 


3.4 


4.0 


.0 


B.B 


IV. 
V. 


Indirect costs 
Total expenditures 


^ 45.1 


. 4.2 
i 27.5 


, .6 


, -I 
^4.7 


.0 
^.0 


1.6 
i 10.4 






PLS: Peninsula Library Systems 












Total 
(1) 


Quest icr, 
AnSM?rinq 
(2! 


Education, 
Training, 
Dual Con 
(3) 


Develop 
Specialized 
Resources 
(4) 


Serving 
Under- 
served 
(5) 


All 
Other 
(6) 


11. 
4. 
5. 
6. 


Direct salaries It benefits 
Professional eiployees 
Contract labor 
Support staff 


p 34.5 
.0 
10.7 


.0 
7.0 


i6.9 
.0 
2.1 


i 3.5 
.0 
l.t 


i.o 

.0 
.0 


i 3.5 
.0 
.5 


III. 


Other direct costs 














B. 


Data-base searching 
Total costs 


3.5 


2.B 


.2 


.0 


.5 


.0 


9. 


Telephone 


.S 


.3 


.1 


.1 


.0 


.1 


10. 


Reference materials 

10b For host collection 
10c For center collection 


10.0 
10.0 
.0 


5.0 
5.0 
.0 


.0 
.0 
.0 


2.5 
2.5 
.0 


2.5 
2.5 
.0 


.0 
.0 
.0 


11. 
12. 


Supplies and equipient 
Other 


5.2 
.8 


3.6 
.0 


1.0 
.0 


.5 
.0 


.0 
.0 


.0 
.0 




SUBTOTAL 


65.2 


39.4 


10.3 


7.6 


3.0 


4.1 


IV. 
V, 


Indirect costs 
Total expenditures 


. 1.3 
^66.5 


i 40.2 


iio.5 




^3.1 


i \'.2 



- 6 - 

86' 



SJVLS: San Joaquin Valley Library Systeo 







Total 

n \ 
W } 


Question 
AnsMering 


Education, 
Training, 
Dual Con 


Dev:-..; 
Specsalizsd 
Resources 

HI 


Serving 

under" 

served 


HI I 

Other 


11. 

4. 

S. 
6. 


Direct salaries \i ^amhts 
Professional saplti/n*.^ 
Contract labor 
Support staff 


li&2.4 
.0 
32.1 


* A 

i:<.Q 


jt5.6 

' A 
• U 

2.2 


i 5.0 

' ft 

• U 

12.2 


.0 


^5.0 
■ u 
3.9 


ttt 
HI. 


Other direct costs 














8. 


uaid case sedrbniny 
Total costs 


2.9 


2.B 


.1 


.0 


.0 


.0 


9. 


Telephone 


2.5 


2.3 


' A 


.1 


.0 


.0 


10. 


Reference laterials 

10b For host collection 
10c For center collection 


8.9 
1.4 
7.5 


6.9 
1.4 
7.5 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


11. 
12. 


Supplies and equipsent 
Other 


6.0 
15.3 


3.0 
11.2 


.9 
.8 


1.8 
2.6 


.0 
.0 


.3 
.8 




SUBTOTAL 


130.1 


B8.7 


9.8 


21.7 


.0 


9.9 


IV. 
V. 


Indirect costs 
Total expenditures 


^ i3&.l 


i 92.8 


.5 

410.2 


f 22.7 


i .0 


i 10.4 






Santiago Library Systei (OCPL) 












Total 
(1) 


Question 
flr.vKering 
(2) 


Education, 
Training, 
Dual Con 
(31 


Develop 

Resources 
(4) 


Serving 
Under— 
lerved 
(5) 


AH 
Other 
(6) 


II. 
4. 

6. 


Direct salaries I benefits 
Professional employees 
Lontract laoor 
Support staff 


33.9 
.0 
.0 


A 30.2 

.0 
,0 


^3.4 
.0 
.0 


i.o 

• w 

.0 


.0 

• V 

.0 


^.3 
.0 
.0 


Ul. 


umer oireci cosis 














8. 


Data-base searching 
Total costs 


13.1 


13.1 


.0 


.0 




.0 


9. 


Telephone 


.5 


.5 


.0 


.0 


.0 


.0 


10. 


Reference materials 

10b For host collection 
10c For center collection 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 

.0 

.0 


.0 
.0 

.0 


11. 
12. 


Supplies and equipment 
Other 


.7 
.2 


.b 

.2 


.1 

.0 


.0 
.0 


.0 

. .0 


.0 
.0 




SUBTOTAL 


4B.4 


44.5 


3.5 


.0 


.0 


.3 


IV. 
V. 


Indirect costs 
Total expenditures 


1.4 
\' 49.8 


1.3 
i 45.8 


.1 
p 3.6 


.0 


.0 
^0 


^.4 



87 



Serra 







Total 
(1) 


Question 
Answering 
(2) 


Education, 
Training, 
Oual Con 

(3) 


Develop 
Specialized 
Resources 
(4) 


Serving 
Under- 
served 
(5) 


All 
Other 
(6) 


II. 

4. 

S. 
6. 


Direct salaries li benefits 
Professional employees 
Contract labor 
Support staff 


103.0 
.0 
17.0 


<^61.B 
.0 
14.5 


^10.3 
.0 
.0 


^10.3 
.0 
.0 


^15.5 
.0 
.9 


^5.2 
.0 
1.7 


III. 


Other direct costs 














8. 


Data-base searching 
Total costs 


2.0 


l.B 


.1 


.1 


.0 


.0 


9. 


Telephone 


le.o 


1&.2. 


.0 


.0 


.0 


l.B 


10. 


Reference aaterials 

10b For host collection 
10c For center collection 


1.0 
.0 
1.0 


.5 
.0 
.5 


.0 
.0 
.0 


.0 
.0 
.0 


.5 
.0 
.5 


.0 
.0 
.0 


11. 
12. 


Supplies and equipaent 
Other 


5.B 
B.7 


5.2 
7.B 


.0 
.0 


.0 
.0 


.0 
.0 


.6 
.9 




SUBTOTAL 


155.5 


107. B 


10.4 


10.4 


16. B 


10.1 


IV. 
V. 


Indirect costs 
Total expenditures 


li.7 
^ 172.2 


. 11.6 
)(ll9.4 


^11.5 




if lb. 4- 


. 1.1 
j. 11.2 



South Bay 



Vi:itation, Develop 

Qui^.s - : fining, Soecializcd 

Total Ar'-r ^. > . Con llesources 

(1) ■ (3) (4) 



II. Direct salaries li benefits 

4. Professional employees 

5. Cr: . - . rx labor 

6. t ,r staff 


4 44.2 
.0 
15.7 


.0 
3.9 


^B.B 
.0 
3.9 


i 6.6 
.0 
3.9 


<4.4 

.0 
1.6 


^4.4 

.0 
2.4 


III. Other direct costs 














Data-base searching 
8. Total costs 


1.5 


1.4 


, 1 


.1 


.0 


.0 


9. Telephone 


2.4 


1.4 




.3 


.2 


.1 


10. Reference materials 

10b For host collection 
10c For center collection 


.B 
.0 
.B 


.7 
.0 
.7 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


.1 
.0 
.1 


11. Supplies and equipaent 

12. Other 


5.0 
8.2 


1.5 
1.6 


1.5 
2.S 


1.5 
2.1 


.2 
.4 


.2 
2.1 


SUBTOTAL 


77.7 


30.4 


16.7 


14.5 


6.9 


9.3 


IV. Indirect costs 

V. Total expenditures 


.0 

f77.7 


.0 
^30.4 


.0 
/16.7 


^14.5 


/6.9 


/9.3 



- 8 - 

88 



Serving 

Under- All 

served Other 
(5) (6) 



South State 







Total 
(1) 


Question 
AnsNering 
(2) 


Education, 
Traini 
Gual Con 
(3) 


Develop 
Specialized 
Resources 
(4) 


Serv:ng 
Under- 
served 
(5) 


All 
Other 
(6) 


ill 

4. 

5. 
b. 


Qirprf calariPC L hpnp^ifc 

Professional eiployees 
Contract labor 
SuDDOrt ctaf^ 


^ .0 
.0 
7.7 


^.0 
.0 
.0 


t.o 

.0 
1.9 


^.0 
.0 
3.9 


i.o 

.0 
1.9 




III. 


Other direct costs 














B. 


Data-base searching 
Total costs 


4.9 


4.9 


.0 


.0 


.0 




9. 


Telephone 


.0 


.0 


.0 


.0 


.0 




10. 


Reference materials 

10b For host collection 
10c For center collection 


49.5 
49.5 
.0 


49.5 
49.5 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 




11. 
12. 


Supplies and equipient 
Dther 


.0 
33.9 


.0 
.0 


.0 
.0 


.0 
33.9 


.0 
.0 






SUBTOTAL 


96.0 


54.4 


1.9 


37. B 


1.9 




IV. 
V. 


Indirect costs 
Total expenditures 


.2 

i96.2 


f 54.5 


.0 
^.9 


^37.B 


.0 
^1.9 


i 



.0 
.0 



.0 

.0 

.0 
.0 
.0 

.0 
.0 

.0 



- 9 - 



8;/ 



Bay Area Reference Center (BARC) 

Education, Develop Serving 

Question Training, Specialized Under- All 

Total AnsMering Qual Con Resources served Other 

(1) (2) (3) (41 (5) (61 



II. 

4. 

5. 
6. 


Direct salaries I benefits 
Professional eipioyees 
Contract labor 
Support staff 


♦ 300.5 
.0 
59.5 


^159.3 
.0 
2G.6 


^54.1 
.0 
4.2 


i 57.1 
.0 
19.6 


4.0 
.0 
.0 


!j'30.1 
.0 
7.1 


III. 


Other direct costs 














B. 


Data-base searching 
Total costs 


11. G 


11.2 


.1 


• ^ 


.0 


.1 


9. 


Telephone 


5.B 


3.5 


.9 


• r 


.0 


.6 


10. 


Reference laterials 

lOb Far host collection 
10c For center collection 


1.1 
.0 
1.1 


.B 
.0 

.e 


.1 
.0 
.1 


• i 

• V 

• 1 


.0 
.0 
.0 


.1 
.0 
.1 


11. 
12. 


Supplies and equipient 
Other 


IB. 3 
4.1 


11.0 
3.1 


l.B 
.4 


4.6 

. z 


.0 
.0 


.9 
.4 




SUBTOTAL 


401.1 


2>".4 


61.6 


B2.B 


.0 


39.3 


IV. 
V. 


Indirect costs 
Total expenditures 


, 20.1 


, 10.9 
^22B.3 


4 64.7 


4B7.0 


J -0 
4.0 


J 2.0 
4 ^1.2 






Southern California Ansitering Netitork (SCAN! 










Total 
(11 


Duestisn 
AnsNering 
(2) 


Education, 
Training, 
Dual Con 
(31 


Develop 
Specialized 
Resources 
(4) 


Serving 
Under- 
served 
(5) 


All 
Other 
(6) 


II. 
4. 

5. 
b. 


Direct salaries ti benefits 
Professional eiployees 
Contract labor 
Support staff 


i 341. B 
.0 

25,2 


i 21B.B 
.0 
20.2 


i 17.1 
.0 
.0 


f5B.l 
^ .0 
5.0 


.0 
.0 


i 47.9 

A 
^0 

.0 


III. 


Other direct costs 














a. 


Cata-base searching 
Total costs 


&.1 


.0 


.0 


.0 


.0 


.0 


9. 


Telephone 


&.3 


&.2 


.0 


.0 


.0 


.1 


10. 


Ref^riince laterials 

10b For host collection 
10c For center collection 


3.0 
.0 
3.0 


3.0 
.0 
3.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


.0 
.0 
.0 


11. 
12. 


Supplies and equipient 
Other 


20.4 
.0 


17.3 
.0 


.4 
.0 


2.0 
.0 


.0 
.0 


.6 
.0 




SUBTOTAI 


402.B 


2&5.4 


17.5 


65.2 


.0 


4B.6 


IV. 
V. 


Indirect costs 
Tctal expenditures 


32.2 
4435.0 


21.2 
:f 266.6 


1.4 
^tG.9 


5.2 
f70.4 


.0 
4.0 


3.9 
f 52.5 



- 10 - 

9U 



Surviy Tibli 111 Allecitiofl ol b}ni\\vn br Kiftrmci fuiictioiii 
RilifMci Cintiri, BMIC, SUN 
IFV m\ 





111 


121 


131 


14) 


131 


lit 


171 


181 


(1) 








II ThouMidil 








IPirciit Sliiriil 












Siralof 






EducitiM 


hn\tif 


mi 




iDtll 


Buiition 


Iriinini, BpKiilitii 


nil 


1 fiUHtiOfl 


Iriiiiiit 


9piciiliii4 


Nm 




Hinllini 




RiiourcH 


Dlliir 


1 Hindliii] 


Dull Con 


RiiNrcii 


Dtli(r 


iMiinMiitHMinn 


itiHnMnnNuiinminimiiniiMuiiMniiaMiiMiinniinMtmiiiiuiiiiiiiinnuiiiiuuuiiunN 


DAIIS 


III0.2 


193.2 


13.1 


13.0 


(44.2 


1 30.11 


5.31 


4.51 


40.11 


IUCI(|IOI.D 


?7.2 


31.4 


ll.f 


3.1 


29.8 


1 32.1 


12.2 


5.2 


21.( 


<Mf 


70.1 


31.1 


2.7 


7.3 


2.0 


1 82.7 


3.8 


10.7 


2.1 


IIUM 


lll.f 


7?.i 


3.i 


4.8 


21.T 


1 71.1 


3.0 


4.3 


I9.( 


KIS 


240.1 


I3S.S 


20.1 


\U 


47.7 


1 M.8 


8.4 


7.0 


I9.t 


nui!: 


U.3 


30.! 


12,1 


10.4 


II.S 


1 47.1 


11.3 


15.8 


I7.( 


IMS 


104.4 


71.4 


I3.i 


.0 


17.4 


1 i8.2 


13.1 


.0 


l(.7 


NOUH MY 


n.i 


3?.7 


Il.t 


4.» 


23.2 


1 iO.4 


ll.l 


3.0 


23.3 


nun in dinii vvi it 


53.2 


3i.f 


U 


2.i 


i.8 


1 i1.4 


12.1 


4.9 


12.8 


KNTH W.[-mt.lt 


[2.7 


12.2 


.4 


.0 


.0 


i 1i.5 


3.2 


.0 


.3 


RwniH ififiib ti»inwin 


IS.I 


27.J 


4.1 


4.7 


8.9 


1 i0.1 


9.0 


10.3 


I9.( 


PIS 


li,9 


40.2 


10.3 


7.7 


8.1 


1 (0.4 


13,8 


ll.( 


12.1 


sms 


Ix.l 




in 1 


11 1 










7 k 


SMTIM 


49.,1 


43.e 


3.i 


.0 


.4 


1 12.1 


7.2 


.0 


.7 


m 


172.2 


ii?.4 


11.3 


11.3 


21.8 


1 (9.3 


(.7 


(.7 


17.3 


m m 


77.7 


30.4 


I&.7 


14.3 


li.2 


1 39.1 


21.3 


!e.( 


20.8 




?i.2 


34.3 


1.1 


37.8 


1.9 


1 3i.7 


2,0 


39.3 


2.0 


Totil 




4l,02i.S 


mi.3 


Il3i.l 


1271.1 


1 (3.51 


1.41 


1.71 


17.31 




m 


Ii0.1 




l?.2 


(U.4 










MK 


(421.2 


1229.3 


U4.7 


197.0 


(41.2 


1 34.2 


13.4 


20.7 


9.8 


SCM 


433.0 




ie.i 


70.4 


51.1 


1 (5.9 


4.3 


li.2 


I3.& 


ToUl 




(SI4.f 


I63.i 


9137.4 


(100.3 


1 (O.II 


1,81 


18.41 


11.71 




m,\ 


I2S7.S 


MI.S 


(78.7 


(54.1 











Hotiii 

Mils prDvUH Mni library Lim Sorvici. Thit iirvici tfafjloyi 13 
fvHm ffOlHiionali M ippmi in tlis Ml othir* colyn). 



Ttii 'ill other" coluM ntUiu dati rnortil oo 'wm\ thi mdvfiifvri,' 
Ibit raipwidiflti did not im'Ai the Rilii;'i of thK9 coiti. 
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Surm libli III! Bufitlofl Hindllno CoipirliDiiii Rilirinti Mm, (ARC, tni SCM 
' IF< 19851 



(II (21 131 

I ol I of I Spint 

Intn IhiKtiHii DuiitiDfli on OH 

iiN Ric'd iDiiiirdl lOOOil 

iuiti»niiiiiiiimini»i>>»"Mi3»":i()") >•> 



Ml (SI li) I 171 
lolil I oi I Cost 

I Soent lotil Spent }v qstn I Coluin 

IDDOs) on of) receded 

:xfs:iBciiiac;::sisiMn:iiciiaiiiiiiniiKiiiiii 



Mils 

mi m 


I,IM 
1133 
IjlOB 


10.31 
ll?.f 
B2.2 


155.2 
S1.4 
S8.i 


(110.2 
97.2 
70.B 


50.1! 
52.9 
B2.8 


MB 

II 


1 II.D 
1 5.0 
1 i.O 


11,0 
9.0 
7.0 


li.O 
13.0 
3.0 


1 w 

i.5 
10.0 
i.5 


immn 
m 

HONC 


3,(06 
l,OH 


21.0 

n.3 

m 


M 
ISS.S 
30.9 


III.9 
241.1 


71.1 
U.6 
47.2 


23 
17 
29 


1 2.0 
1 1.0 
1 13.0 


5.0 
1.0 
li.O 


Il.O 
1.0 
I7.D 


Id.O 
17.0 
15.0 


INIS 

iigiiTii Mr 

fHlNlK DlRlt*DUIIC 


l,HO 

m 

\ w 


70.« 
S(.2 

IViV 


71.4 
M.7 

JDiT 


I04.( 
9B.8 

53 2 


M.3 
iO.4 

&9.( 

Uf 1 1 


30 
M 
29 


! 9.0 
1 K.O 
1 ID.O 


4.0 

i.O 
13.0 


3.5 
9.5 
(.0 


4.0 

2,0 
Il.O 


MRIH STAIE-EUREM 
lORlHSIAlE-SHASIA 
PLS 


m 

1,052 
1,(58 


SO.D 
i3.D 
W.9 


12.2 
21.5 
<0.2 


12.7 
45.1 
ii.S 


9i.l 
il.O 
iD.5 


115 
2B 


i 17.0 
1 15.0 
1 6.0 


17.0 
13.0 
12.0 


1.0 

8,0 

9.9 


1.0 
14.0 


Sims 

SANIIflM 
SERIIA 


2,ns 

2,105 


fO.6 
40.3 
7?.3 


f2.B 
4S.B 
119.4 


131.1 
49.B 
172.2 


tt.2 
92.0 
».3 


32 
5( 

57 


! 3.0 
1 li.D 
1 (.0 


2.0 
10.0 
3.0 


5.5 

2.0 
[(.0 


■ 3.0 
5.0 


SOUIHBAV 
S0U1HS1AIE 


MIS 

l,SiB 


fO.2 
75.4 


30.4 
S4.S 


77.7 
U.2 


39.1 
Si.7 


27 
35 


1 12.0 
1 7.0 


13.0 
B.0 


15.0 
12.0 


I3.D 
8.0 


Total 


3309^ 


ii2.n 


|,022.i 
iO.I 


l,tOS.i 
91.6 


13.51 


131 










m 

SCM 


m 

3(» 


M 

Nil 


228.3 

m,k 


421.2 
435.0 


S4.2 
U.9 


76 
83 


1 2.0 
1 1.0 


2.0 
1.0 


2.0 
1.0 


2.0 
1.0 


Totil 
Aneriti 


m 

3222 


M 


914.9 
2S7.S 


BS(.2 
42B.I 


iO.ll 


leo 











lei 19) ' iioi 

Rinliii 

[olum Coluin Coluifl 

131 151 lil 

a^iiiiiiiii*iiiiunii>i>iuiit<i">iii 



Mcit 

BHi BuHtion Hinillin; 
Mi Not Ayiilibli 

ColUDflt II) ini 121 in inti on Tibli I, Nhich vit cotpiltd by ]in( Nenion, 
libriry Nlopidit Ssrvictt, Ciliiormi Stiti Library. 



Survty libit IVi ProlllH IMI SUIIIi Riltrmci Cmtiri, M, tti m 





II) 


121 


131 


141 


13) 


lil 


17) 


18) 


19) 


(10) 


(II) 


SyitH 






1 


Pircmti)! ol totil 1 




Eipiriiflci livirifi |fri)i 




Rinliti 


lotil 1 


Totil 1 


1 ProfiiilDflili 


Sipporti 




Proliiiionil 


Support 


Coluii 


CglvM 


NlN 


ilill 


Prod 


1 Filltiii 


Pirttlii 


FtlltiH 


Pirttlii 


Riltrtnct 




HHC 


(7) 


(B) 


iiuiiuimti««iiiniiiuiiiiiiniiiiiiiiuiiiiiiiiiiiiiiiiiiiiiiiii»»iMciiiiiiiiiBiittiiiiii8iiniiiimiiiiiii 


Mils 


2O.0 


11.0 


1 3.01 , 


83.01 


.01 


10.01 


3.0 




2.3 


17.0 


17.0 


HIICItEllli 


3.0 


2.0 


1 PVir 


.0 

IV 




(1 


Id. J 


II % 

Hid 


1 A 

J|V 


t A 
JiO 


1 A 

3.0 




).0 


2.0 


1 33.3 

1 


33.3 


33.3 


.0 


3.3 


2.3 


?iO 


13.0 


13.0 


imMS 


(.0 


3.0 


1 73.0 


.0 


23.0 


.0 


7.0 


4.7 


y 

ilM 


12.0 


11.9 


IKIS 


?.fl 


i.O 


1 71.4 


14 ] 


II ] 

11. i) 


iV 


17 7 


/id 




/■O 


3.0 


KMC 


4.0 


3.0 


1 23.0 
1 


30.0 


2SiO 


lO 


lOiO 


7.2 


2i0 1 


10,0 


9.0 


ffUS 


3.0 


2.0 


1 U.7 

1 wi r 


0 

|V 


A 

IV 


tfjij i 




7 1 


2.3 1 


3.0 


i A 

(.0 




4.0 


3.0 


1 23,0 


30.0 


23.0 


.0 1 


11.7 


3.0 


2.9 1 


I.O 


14.0 


WHIHSmE-BUnE 


2.0 


1.0 


1 30.0 
1 


.0 


.0 


30.0 1 


20.0 


14.0 


8.0 1 


1.0 


2.0 


NOIITHSIIIIE-EUKKII 


2.0 


1.0 


1 .0 


30.0 


.0 


30.0 1 


4.0 


3.3 


3.0 1 


li.O 


13.0 


NOItlHSIIirE-SllASIA 


2.0 


1.0 


1 30.0 


.0 


.0 


30.0 1 


10.0 


i.3 


i.O 1 


10.0 


7.0 


PLS 


2.0 


1.0 


1 50.0 

1 


.0 

IV 


0 

.V 


VIA 1 


lA A 


\ A 
uiU 




lA A 


lA A 


SJVIS 


7.0 


3.0 


1 

1 14.3 


S7.I 


2B.i 


.0 1 


18.0 


11.2 


17.9 1 


2.0 


4.0 


swiimio 


1.0 


. 1.0 


1 I0O.0 


.0 


.0 


.0 1 


U.0 


13.0 


NA 1 


4.0 


t.O 


SEIIRII 


5.0 


4.0 


1 40.0 

1 


40.0 


.0 


20.0 1 


13.0 


i.3 


3.0 1 


i.O 


8.0 


SOUtHBAY 


5.0 


3.0 


1 2O.0 


40.0 


.0 


40.0 1 


i.O 


4.7 


2.0 1 


13.3 


11.9 


souiH mn 


2.0 


1.0 


1 30.0 
1 


.0 


.0 


30.0 1 


1.0 


.9 


IM 1 


13.3 


li.O 




4.3 


3.4 


1 43.n 

1 


24.71 


lo.n 


20.81 1 


10.9 


i.3 


3.7 1 






m 


II.O 


e.o 


1 

1 72.7 


.0 


18.2 


9.1 1 


18.4 


I7.i 


1.3 1 


1.0 


2.0 


m 


8.3 


7.5 


1 82.4 

1 


5.9 


li.e 


.0 1 


19.7 


29.i 


.1 1 


2.0 


1.0 




U 


?.8 


1 77.31 


2.11 


13.01 


4.311 


19.1 


23.i 


.8 1 







NotHt 

Hi Hott libriry 

Rti SyitH RdiTKici Cntir 

'Util Stiff' ill coliM I iiicliilH protniioiiil tni lupport itifti both full-tin, 
pirt-tiH, contrict, ptriinKit, ni tiiporirif, 
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Surviy libit Vi Still Prollli, Prolmionilii llilirinti Cintiri, Ml ini SCAR 

in m\ 



III 121 131 (41 151 li) 171 Ifl 1 IIOI III) 1121 1131 

, . """"W""! IFudiMiiiniMllKillonlPircKilSliiriili 
SyitN Prolitilf IFTProl IPIProl hithttirNii ProlHinl vithllrf Kith 1 I Ml 
Niit Inchontrct US )IIL9 Piftrenct Mm Hoit lit 1 IW l[m IDSH Dthir 

liUimiiiiMiiMuii KiiimiiiiiminiiiiiiiixitMiuiiiiig i tiiiiuuniiiMiiiinii in iumi iiuiiniiiiiiini 


MHIS 

BLKK soil 
«-W 


IS.( 
2.0 
2.0 


I.D 
2.0 
1.0 


17.0 
.0 
1.0 


IB.0 
1.0 
1.0 


.0 
1.0 
1.0 


54.0 
33.0 
II.D 


11.5 
15.0 
5,0 


.0 
6.0 
.0 


1 U.01 
1 50.0 
1 90,0 


10.01 

15.0 

4.0 


2.01 

5.0 

3.0 


25.01 

30.0 

3.0 


HHIMII 

KIS 

IHMC 


3.0 

i.O 
3.0 


3.0 
S.0 

1,0 


.0 
1.0 
3.0 


3.0 
i.O 
3.0 


.0 
4.0 
.0 


21.0 
7i.O 
30.0 


ii.o 

2i.5 
ID.S 


3.0 
14.0 
II.O 


1 75,0 
1 73.0 
1 B2,5 


6.0 
9.0 
6,3 


6.0 
6.0 
6.2 


13.0 
12.0 
5.0 


WIS 

nun in m 

wpiH mi-i 


2.0 

tf.V 

1.0 


2.0 

1 A 

I.V 

1.0 


.0 

l.V 

.0 


1.0 

) A 

1.0 


1.0 

1 (1 

liU 

.0 


30.5 
20.0 


14.5 

1 A 

3.0 
14.0 


.0 

1 A 

4.P 
.0 


1 72.5 
1 60,0 
1 62.0 


12.0 
10,0 
13.0 


.0 
5.0 
8.0 


15.5 
25.0 
17.0 


mni SHTE-E 

NORTH StAIE-E 
PIS 


1.0 
1.0 
1.0 


.0 
1.0 
I.D 


1.0 
.0 
.0 


1.0 
1.0 
1.0 


1.0 
.0 
.0 


4.0 
10.0 
10.0 


1.3 
1.5 
50.0 


2.0 
5.0 
.0 


1 100.0 
1 i0.0 
1 60.0 


j.O 
20.0 


.0 
5.0 
10.0 


.0 

30.0 
10.0 


SJVLS 

SEPim 


S.0 
4.0 


1.0 

2.0 


4.0 

2.0 


1.0 
1.0 
4.0 


4.0 
.0 

1.0 


90.0 
It.O 
52.0 


2?.0 
1.0 
10.5 


27.0 
14.0 
14.5 


1 75.0 
1 89.0 
1 60.0 


9.0 

10.0 
ID.D 


8.0 
.0 
10.0 


8.0 
10 
20.0 


SDUiH enr 
soyiH smiE 


3.0 
1.0 


1.0 
1.0 


2.4 
.0 


2.0 
.0 


1.0 
1.0 


16.0 
i.O 


10.5 
.? 


3.5 

.0 


1 45.0 
1 60.0 


20.0 
10.0 


15.* 
10.0 


<t).0 
20.0 




3.4 


I.J 


l.» 


2.S 


.? 


30.4 


12.8 


i.5 


1 69.21 


10.01 


5.81 


15,01 


MPC 
SCM 


S.0 
7.5 


S.0 

7.0 


.0 
.5 


8.0 
7.5 


1.0 

1.0 


147.5 
I4e.0 


iO.O 
97.0 


81.0 
125.0 


1 53.0 
1 64.0 


18.0 
5.0 


A.. 
17.1) 


10.0 
14.0 


AyKigi 


7.B 


7.5 


.3 


7.8 


1.0 


147.6 


76.5 


103.0 


1 58.51 


II.SI 


18.01 


12.0 


Notiii 



























Nortk StitHi E, Si tti thrif Kortli Stiti host lodtiooii htti, Euriti^Htiioldt, and Shaiti coanty libririii. 
Fit lull-till. 

RM/St RilifNCiCMttri, IMC, and SUi. 
Mli fiueitiofl Handlini 

MliU Education and Trainii) and Oiilltif tofltrol (ihicli liai iiiit bifil, 
OSR: Iiviloping SpKialiud Riiovrtii. 

'All Dthir' indudnr Sirviti to thi UndirurYtd and othir un^icKiid iipinditurii. 

ColUM III Includii full-tlHf pirt^tlH, and cofitrati prolHiiofiil itaff. Ihi Ntrr (or WH iiclvdii 
Dfli halHiii contract profniional iho \i not i praliiiional librarian. 

Ihi luRCtional tin allocation pirctnt ibarii m lor proiitiofial itall only anil an baiid on ijuntiofiiiairi 
aniiiri (or FK l?6S. 
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Survir libli Vli 0«iillM Slillitici. Still ail toitii Mvm Cintiri, IMC, mil 9CAII 
IFV IfDSI 



(II 111 (» 1(1 131 lit in isi ni iiui 

I of lol Oit/itill Iit/itill Mfnl lotil I of 

fMhUH niM Buiitiwii JiiMtlofli 131/ Mimrii onSH tSpwl IoIjI Hpu. >/W 

UdCHitrtt OH Ric'd ininKid II2IIIII) KIIISI lOOOil lODOil on OH 171/131 

lllHIIIIH«IIIMMi«"'«"IIM""""««"W""" IIIIIHIIIIIIIIHHHIIIIIIMM""""""""'"""*"""""" 



MllE 


I.]/ 




1 111 A 


on 11 




IDT 


III t 


IIDS.9 


38,71 


II9.I 


hkkhii 


IM 


90.0 


1,133.0 


07.9 


1,133 


1,431 


91.4 


97.2 


92.9 


31.9 


«w 


1.10 


10.0 


um 


B2.2 


1,124 


1,339 


9B.1 


70.8 


82.7 


31.4 


imMS 


3.00 


79.0 


V lAI A 

3,(0(.O 


74.0 


1 III 


1 I1A 


Mi« 


III 0 

nil' 


Willi 


19.1 


KLS 


S.00 


73.0 


f,3U.0 


9U 


2,911 


2,414 


199.9 


24D.I 


14.8 


11.1 


m 


l.» 


12.! 


I.Oif.O 


B7.1 


120 


719 


24.2 


13.8 


31.7 


22.1 


m 


2.00 


72.9 


I.MO.O 
f79.0 


7I.( 


993 


779 


71.4 


104,1 


18.2 


49.1 


WHIHNI 


1.12 


10.0 


94.2 


94B 


914 


99.7 


98.8 


10.4 


11.0 




I.W 


Si.V 


1.281.1 


10.0 


2,079 


1,249 


31.9 


93.2 


19,4 


2B.7 


millf SIME-EDKIEII 


.SO 


lOO.O 


101.2 


90.0 


212 


101 


12.7 


12.7 


100.0 


119.1 


HotiiH mmm 


1.00 


io.o 


1,032.2 


13,0 


1,794 


1,109 


27.9 


49.1 


11.0 


21.1 


Ai 


1.00 


iO.O 


M3D.0 


90.9 


2,430 


2,210 


40.2 


11.9 


10.4 


27.9 


m 


I.i0 


79.0 


2,929.0 


90,1 


2,430 


2,208 


92.8 


131.1 


18.2 


31.7 


5IW11II60 


1.00 


If.O 


894.0 


40.1 


910 


3B7 


49.8 


49,8 


92.0 


91.1 


SEMII 


2.S? 


60.0 


2,109.0 


77.3 


1,399 


1,048 


Bl,4 


172.2 


90.2 


41.0 


SOUTH r 


1.00 


».o 


1,119.0 


90.2 


2,47a 


2(231 


30.9 


77.1 


J9.2 


27.3 


SDUIH SIIIE 


I.DO 


U.O 


i,9ie.o 


79,4 


2,113 


1,970 


94.9 


91.2 


91.7 


34.8 




1.7? 


».2t 


1,941.7 


79,71 


1,919 


MBB 


191.2 


194.4 


99.91 


428.9 



ftAM 

NXl 


B.O0 


93.0 


2,990.0 


SCNI 


7.90 


14.0 


3,494.0 




7.79 


98.91 


1,272.0 



NdIhi 

Ml not iviilibli. 
BHi quntion liinlliii|. 



705 


M 


22B.3 


421.2 


94.2 


71.4 


720 


HA 


281.1 


439.0 


19.9 


83.0 


711 




♦297.9 


IB91.2 


10.11 


♦79.9 



9i) 



Diti {or coUn 111 iri i«UH froi thi aSX Sritn Eipmllton Ro^orte lor F( 1914/89. 
Oiti lor toliiKii 131 ni 141 iri Iroi ?i)li I, coopiiri Ir "wioi ol Ihi Cillloriili Sliti Lilrirf. 
Nortli suit- lutli iKlodM tw ^;iJflcr-tiH Iwpcfirj rilirnH libririim. 
Soiitli Stiti hid ID proliiiiooi! itill, liit rKiivil in ii*kind cwtribitioi al proliiiloflil 
I rdiriflK iirvicii Iroi lA Countif Piiblic Libr«r^ 



TABlETgnTTtble Df Host/PotentUI Host libraries 



Table VII 
fOTENTlAl HOST □ 



HOST Q 




,1. Butte 

2. EurekT: 

7. Norwaik 

.9. LAPL 

10. Oakland 

11. Orange County 

12. R-i^erside 

13. Sacramento 

14. San Diego Public Library 

15. San Francisco 

16. San Jose 

17' San Mateo Public Library 

18. Santa Barbara 

19. Shasta County 

20. Sonoma County 

21. Stockton-San Joaquin 

22. Fresno County 

5. Salinas Public Library 



E3- 



I. 


Berkeley 






Contra Costa 




3. 


Kern County 




4. 


Lonq Beach 




7. 


Pasadena 




9. 


Stanislaus 




10. 


Torrance 




11. 


Tulare 




13. 


CSU-Chico 




14. 


L.A. County, 


Carson 


15. 


L.A. County, 


Huntington Pa 


16. 


L.A. County, 


Lancaster 


17. 


L.A. County, 


Kontabello 


18. 


L.A. County, 


West Covina 


19. 


Glendale 
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Survty Tablt Vllh Total Colltction and Staff: Hoit Ukrarltt 

IFY198SI 



in 121 (31 141 

TOTAL COHECTKM lOOOil 



Hott Library 



fitnKal 
Voluatt 



191 



6ro«tli 
Ratt 



Rtftrtnct 
Voluati 



Broith 
Ratt 



PtriodMi 
Titlti 



Govt 

DOCB 



(7) 



Databait 

lYts, No) 



IB) 



FTE 
Rtf Staff 



191 noi 

STAFF (auibfrl 



Rtf Staff 
Hith M.8 



Rtf Staff 

ii/o MLS 



ill) 



Rtf Staff 
> NL8 



Mtt 


70.0 


4.01 


6.3 


4.61 


.2 


4.0 


N 


1.0 


1.0 


.0 


.0 


Eurtka 


180.0 


HA 


15.3 


HA 


.3 


3.9 


N 


7.5 


7.5 


.0 


.0 


Nomalk 


U3.0 


4.n 


9.9 


13.11 


.8 


62.7 


t 


6.9 


6.0 


.5 


1.0 


Ln Afiftln PL 


1,075.0 


4.11 


1,959.2 


4.21 


18.9 


1,281.2 


V 


79.0 


79.0 


.0 


12.0 


Oakland 


260.9 


3.31 


43.1 


3.11 


2.9 


376.3 


Y 


22.2 


17.4 


1.0 


4.0 


Oranqt/Brdn Brovt 


113.2 


3.B1 


15.8 


10.81 


.9 


1.1 


Y 


9.5 


4.0 


5.5 


.0 


iivtriidt 


187.3 


B.01 


14.7 


3.41 


.6 


154.2 


N 


13.9 


8.8 


5.1 


.0 


Sacrumto 


300.0 


HA 


21.0 


NA 


1.4 


185.0 


N 


12.0 


12.0 


.0 


4.0 


Salinai 


203.8 


20.61 


20.0 


7.01 


.8 


NA 


N 


6.0 


4.0 


2.0 


.0 


S«i lit^D PL 


617.9 


2.61 


113.4 


2.81 


4.1 


1,214.6 


Y 


22.0 


11.5 


10.5 


3.0 


Saa FranciKO PL 


550.0 


2.91 


650.0 


3.41 


10.1 


3,500.0 


Y 


64.0 


64.0 


.0 


.0 


Sji Joit PL 


300. 0 


7.11 


30.0 


8.21 


1.0 


NA 


Y 


34.8 


32.0 


2.B 


6.0 


Sat Ratto PL 


213.0 


4.21 


20.0 


11.01 


.7 


21.0 


N 


9.B 


5.8 


.0 


3.0 


Santa Barbira 


130.0 


3.41 


13.2 


7.61 


.6 


8.0 


t 


9.9 


8.5 


1.0 


1.0 


Shaita CO 


130.0 


4.31 


9.0 


8.91 


.4 


55.0 


t 


1.0 


1.0 


.1 


.0 


SoflOM CO 


13&.8 


3.11 


37.0 


6.81 


1.3 


NA 


Y 


13.9 


11.5 


.0 


1.0 


Stockton 


241.9 


8.01 


24.3 


8.31 


1.6 


• 373.0 


Y 


16.0 


11.0 


5.0 


4.0 


Frtfiio 


349.7 


9.91 
• 


60.0 


1.31 


1.2 


550.0 


Y 


13.0 


9.5 


.0 


1.0 


Avtr aqt 


294.B 


3.31 


171.4 


4.41 


2.7 


519.5 




1B.7 


16.4 


1.9 


2.2 



Total I3< 

Nottit 

LftPL boftt botb SCAN and KLS. Thtir cmtribuliM to SCAN it 1120,132 and 155,623 to ICLS. 
San Franciico cofitrlbattd 0181,089 to 8ARC. Thttt totali incUdt Htiaatoi of tht valit of 
shartd cooM)n ipact (139,924 for SCAN, 134,692 for HCLS, and 1100,962 for BARCI. 
Thtit nuabrfi ha¥t bttn ticUdtd froa tht tablt btcauiv ol appirtnt dlfffrtncti in tbt 
in accounting convtntioni that takt tht fifurti non*coopirablt bttmn Loi Angtlti 
and San FranclKo. 



NA: data not avallablt 
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Survty Tiblt III Total Staff and GollKtiMi Pottntial Hoftf 

(FV19eS) 



YOVnL COILECTIM STAFF (nuibtr) 



folMtlal Hnt 


BfAtral 

Vol SMI 


Ofovth 
Rata 


Acfffftfict 
VoUaat 


Erovth 
Rata 


Firiod'li 
Titlai 


Govt 
Doci 


Datakait 

(Yei, No) 


FTE 
Raf Staff 


Raf Staff 
Hith NLS 


Raf Staff 
n/o NLS 


Ral Btaf 

) NLS 

immn 


nrannnMnmsBSi 

Itrktlty PL 


m.o 


BSBBTCMSS* 

3.3Z 


50.0 


14.01 


.7 


NA 




9.3 


3.B 


3.0 


.0 


Coatra Goata CO 


240.0 


3.0Z 


9.4 


4.31 


1.1 


63.0 




13.3 


11.0 


4.3 


.0 


KKn CO 


174.9 


4.0Z 


20.3 


9.81 


.4 


1M.3 




9.0 


7.0 


1.0 


2.0 


Loa^ iMch PL 


312.9 


B.Ol 


28.0 


7.fl 


1.2 


60.0 




24.0 


24.0 


.0 


S.0 


Paiaitna 


212J 


12.91 


33.2 


18.11 


1.0 


297.1 




24.0 


IB.O 


6.0 


6.0 


Staniilaaf CO 


230.0 


8.01 


13.0 


4«71 


.4 


10.0 




11.0 


11.0 


•0 


1.0 


Torraact PL 


258.0 


4. 71 


12.9 


4.71 


1.0 


78.1 




8.3 


6.S 


•0 


.0 


Tut art CO 


164.0 


NA 


13.1 


NA 


.4 


173.6 




6.0 


6.0 


.0 


1.0 


CSU diica 


930.1 


2.41 


32.0 


1.91 


7.4 


102.3 




11.0 


10.3 


.3 


3.0 


LA CI| CaraoR 


104.2 


IM 


10.8 


3. 41 


.7 


23.1 




9.0 


7.0 


2.0 


.0 


m CO, Hmt Pk 


112.0 


4.11 


9.B 


3.U 


.B 


23.7 




6.0 


3.0 


1.0 


.0 


LA CO, Lancait 


133.0 


3.31 


7.0 


4.31 


.7 


46.0 




3.0 


6.0 


.0 


.0 


LA CO, Nonttltllo 


132.2 


3.31 


19.0 


4.81 


1.1 


66.0 




11.0 


12.0 


.0 


2.0 


LA CO, M. Coviaa 


140.4 


4.91 


10.9 


4.61 


.4 


46.7 




10.0 


6.0 


.0 


.0 


SiMialt PL 


329.3 


4.31 


30.0 


NA 


.4 


NA 




10.0 


10.0 


.0 


3.0 


Avara^t 


243.0 


3.01 


23.0 


7.81 


1.2 


87.3 




11.3 


9.7 


1.2 


1.4 



NotHt 

Survtyi MTt itnt to 28 Ubrarlti tith collactioiif ovir 400,000 vo1«mi. 

Thirtm colltctimi vKa tithtr too inII or too ipKializttf, and art not tabilattd. 

CSU Diico Ml indidrd at tht rtqunt o4 North Stata, and Salinai PL at tha rtquait ol NOBAC. 

NAt data not aval libit. 
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